Distributed Systems

Brought by: Swayam

Overview

A distributed system is a software system in which components located on networked computers communicate and coordinate their actions by passing messages. The components interact with each other in order to achieve a common goal. Distributed applications (distributed apps) are applications or software that runs on multiple computers within a network at the same time and can be stored on servers or with cloud computing. This course provides an in-depth understanding of fundamental principles and models underlying the theory, algorithms, and systems aspects of distributed computing. Few Emerging topics such as Peer-to-Peer computing, Distributed Hash Table, Google File System, HDFS, Spark, Sensor Networks and Security in Distributed Systems will also be covered for significant impact. Upon completing this course, students will have intimate knowledge about how things work in a distributed environment.INTENDED AUDIENCE: Any Interested Learners.PREREQUISITES: Minimum: Data Structures and Algorithms Ideal: Basic networking concepts, Basic OS concepts (e.g., processes, threads, synchronization, file systems, scheduling etc.), Advanced Programming (Good knowledge in C and C++).INDUSTRY SUPPORT: Microsoft Research has conducted this course. Various companies like Google, IBM, Cisco, etc, Distributed systems Group and Distributed systems start-ups are working on this field.

Syllabus

Week 1: Introduction to DS, Message Passing, Leader Election, Distributed Models, Causality and Logical Time Week 2: Logical Time, Global State & Snapshot and Distributed Mutual Exclusion-Non-Token and Quorum based approaches Week 3: Distributed Mutual Exclusion-Token based approaches, Consensus & Agreement, Checkpointing & Rollback Recovery Week 4: Deadlock Detection, DSM and Distributed MST Week 5: Termination Detection, Message Ordering & Group Communication, Fault Tolerance and Self-Stabilization Week 6: Distributed Randomized Algorithms, DHT and P2P Computing Week 7: Case Studies: GFS, HDFS, Map Reduce and Spark Week 8: Case Studies: Sensor Networks, Authentication & Security in DS

Taught by

Prof. Rajiv Misra

Distributed Systems
Go to course

Distributed Systems

Brought by: Swayam

  • Swayam
  • Free
  • English
  • Certificate Available
  • Certain days
  • All
  • N/A
8.1.2PHP Version246msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (151ms)
    • Application (94.65ms)
    • 1 x Booting (61.3%)
      150.88ms
      1 x Application (38.46%)
      94.65ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed12.61ms
      • select * from `courses` where `slug_en` = 'distributed-systems' limit 1
        4.83ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. distributed-systems
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-05-30 10:08:17' where `id` = 2630
        7.04ms/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-05-30 10:08:17
        • 1. 2630
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (35)
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        160μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (14) and `providers`.`deleted_at` is null
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 2621 limit 1
        210μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 2621
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        GO3OI8UnOTGg2JjApYZm24DvOV2avxn2vmoc8p4f
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/distributed-systems" ]
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/distributed-systems
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "3.135.229.106" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "x-forwarded-for" => array:1 [ 0 => "3.135.229.106" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "947d6ded08502318-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "3.135.229.106" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_X_FORWARDED_FOR" => "3.135.229.106" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "947d6ded08502318-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "55920" "REMOTE_ADDR" => "172.71.255.89" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/distributed-systems" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1748599697.7095 "REQUEST_TIME" => 1748599697 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Fri, 30 May 2025 10:08:17 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InBmUElsWjF0YUd2cHBNODg5Z1RjQ1E9PSIsInZhbHVlIjoidndkdFFXdGtqRVJveklZbDBQc21YQVZSZFB4cmV6L21kWmZES0ZRd0MwbXYyLytSN1grNTQrMGovbVJCYlRkVlhqNy9WVVplSnYzZzdpS3NIMEFFeW9CdVhadWpKaHpLQ1JUaVR6YkpCa3NLZmQxczdvWWhOcDFaOFZLSTdsa3kiLCJtYWMiOiI5ZDk3ZDM0OWQyM2VhOWM0YWY5MzFjZDhmZGUyNjBjNmY0MGJmNjg1YThiMTIxMGE1YzNjZDU3NGI5NTY0NWJkIiwidGFnIjoiIn0%3D; expires=Fri, 30 May 2025 12:08:17 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6InBmUElsWjF0YUd2cHBNODg5Z1RjQ1E9PSIsInZhbHVlIjoidndkdFFXdGtqRVJveklZbDBQc21YQVZSZFB4cmV6L21kWmZES0ZRd0MwbXYyLytSN1grNTQrMGovbVJCYlRkVlhqNy9WV" 1 => "laravel_session=eyJpdiI6Inh4enR5TG9KeG5LQkV1blkySlkyN0E9PSIsInZhbHVlIjoiRjg3OFNjcGhzQTU1dDhhQzJjbTFwRVB2cUp3MEc3dFllSExscWJ6S1VBSlBxcTE3RmpLNkVvTEtaN215UEdtdTc0ZUNlY0lUZ1FuMU80bGxtcU51NXlyRUp0NVpDWG9nZVlhQ0d3WjQ3M24rRGZPMHdNcHEweVl4NDlrandvQ1EiLCJtYWMiOiI4NmEyNWQwMzQ1NGRiZWIwYTY1MjkxNzg2ZTAzMmUzNjk5ZTZhMzRiNzYzODU4NjkyNjQ2MzhkMTI0MjEwNGE3IiwidGFnIjoiIn0%3D; expires=Fri, 30 May 2025 12:08:17 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Inh4enR5TG9KeG5LQkV1blkySlkyN0E9PSIsInZhbHVlIjoiRjg3OFNjcGhzQTU1dDhhQzJjbTFwRVB2cUp3MEc3dFllSExscWJ6S1VBSlBxcTE3RmpLNkVvTEtaN215UEdtdTc0" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6InBmUElsWjF0YUd2cHBNODg5Z1RjQ1E9PSIsInZhbHVlIjoidndkdFFXdGtqRVJveklZbDBQc21YQVZSZFB4cmV6L21kWmZES0ZRd0MwbXYyLytSN1grNTQrMGovbVJCYlRkVlhqNy9WVVplSnYzZzdpS3NIMEFFeW9CdVhadWpKaHpLQ1JUaVR6YkpCa3NLZmQxczdvWWhOcDFaOFZLSTdsa3kiLCJtYWMiOiI5ZDk3ZDM0OWQyM2VhOWM0YWY5MzFjZDhmZGUyNjBjNmY0MGJmNjg1YThiMTIxMGE1YzNjZDU3NGI5NTY0NWJkIiwidGFnIjoiIn0%3D; expires=Fri, 30-May-2025 12:08:17 GMT; path=/XSRF-TOKEN=eyJpdiI6InBmUElsWjF0YUd2cHBNODg5Z1RjQ1E9PSIsInZhbHVlIjoidndkdFFXdGtqRVJveklZbDBQc21YQVZSZFB4cmV6L21kWmZES0ZRd0MwbXYyLytSN1grNTQrMGovbVJCYlRkVlhqNy9WV" 1 => "laravel_session=eyJpdiI6Inh4enR5TG9KeG5LQkV1blkySlkyN0E9PSIsInZhbHVlIjoiRjg3OFNjcGhzQTU1dDhhQzJjbTFwRVB2cUp3MEc3dFllSExscWJ6S1VBSlBxcTE3RmpLNkVvTEtaN215UEdtdTc0ZUNlY0lUZ1FuMU80bGxtcU51NXlyRUp0NVpDWG9nZVlhQ0d3WjQ3M24rRGZPMHdNcHEweVl4NDlrandvQ1EiLCJtYWMiOiI4NmEyNWQwMzQ1NGRiZWIwYTY1MjkxNzg2ZTAzMmUzNjk5ZTZhMzRiNzYzODU4NjkyNjQ2MzhkMTI0MjEwNGE3IiwidGFnIjoiIn0%3D; expires=Fri, 30-May-2025 12:08:17 GMT; path=/; httponlylaravel_session=eyJpdiI6Inh4enR5TG9KeG5LQkV1blkySlkyN0E9PSIsInZhbHVlIjoiRjg3OFNjcGhzQTU1dDhhQzJjbTFwRVB2cUp3MEc3dFllSExscWJ6S1VBSlBxcTE3RmpLNkVvTEtaN215UEdtdTc0" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "GO3OI8UnOTGg2JjApYZm24DvOV2avxn2vmoc8p4f" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/distributed-systems" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]