Become a Deep Reinforcement Learning Expert

Brought by: Udacity

Overview

Deep reinforcement learning is one of AI’s hottest fields. Researchers, engineers, and investors are excited by its world-changing potential. In this advanced program, you’ll master techniques like Deep Q-Learning and Actor-Critic Methods, and connect with experts from NVIDIA and Unity as you build a portfolio of your own reinforcement learning projects.
Master the deep reinforcement learning skills that are powering amazing advances in AI. Then start applying these to applications like video games and robotics.

Syllabus

  • Foundations of Reinforcement Learning
    • Master the fundamentals of reinforcement learning by writing your own implementations of many classical solution methods.
  • Value-Based Methods
    • Apply deep learning architectures to reinforcement learning tasks. Train your own agent that navigates a virtual world from sensory data.
  • Policy-Based Methods
    • Learn the theory behind evolutionary algorithms and policy-gradient methods. Design your own algorithm to train a simulated robotic arm to reach target locations.
  • Multi-Agent Reinforcement Learning
    • Learn how to apply reinforcement learning methods to applications that involve multiple, interacting agents. These techniques are used in a variety of applications, such as the coordination of autonomous vehicles.

Taught by

Alexis Cook, Arpan Chakraborty, Mat Leonard, Luis Serrano, Cezanne Camacho, Dana Sheahan, Chhavi Yadav, Juan Delgado, Miguel Morales, Bardia H., Ross A., Camilo G., Fabian V., Ho Chit S. and Robson M.

Become a Deep Reinforcement Learning Expert
Go to course

Become a Deep Reinforcement Learning Expert

Brought by: Udacity

  • Udacity
  • Paid
  • English
  • Certificate Available
  • Available at any time
  • All
  • N/A
8.1.2PHP Version274msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (169ms)
    • Application (104ms)
    • 1 x Booting (61.75%)
      169.45ms
      1 x Application (38%)
      104.28ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed5.68ms
      • select * from `courses` where `slug_en` = 'become-a-deep-reinforcement-learning-expert' limit 1
        4.14ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. become-a-deep-reinforcement-learning-expert
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-05-18 13:12:44' where `id` = 1280
        710μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-05-18 13:12:44
        • 1. 1280
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (27)
        210μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (6) and `providers`.`deleted_at` is null
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 1273 limit 1
        240μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 1273
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        RMTGKm24H34QYcCo8b5ivkhxaeg5VSslqP8Kw0xf
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/become-a-deep-reinforcement-learning-expe...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/become-a-deep-reinforcement-learning-expert
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "3.14.3.180" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "x-forwarded-for" => array:1 [ 0 => "3.14.3.180" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "941b9b9da9be003f-ORD" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "3.14.3.180" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_X_FORWARDED_FOR" => "3.14.3.180" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "941b9b9da9be003f-ORD" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "22428" "REMOTE_ADDR" => "172.70.126.99" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/en/courses/become-a-deep-reinforcement-learning-expert" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1747573964.6921 "REQUEST_TIME" => 1747573964 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sun, 18 May 2025 13:12:44 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImxhNCtYUWprdUVXSWYxWXkwNmVYOFE9PSIsInZhbHVlIjoiZ1Z2QWx6MXdwYkFsQ0lUY3J1aEYvOWdxZ1d1TnBFb0tjWUlhSFp5aE02T3BKTzZZb1piakZpYzB0RkpPVVBvKzlnQ0NXRm02R25EQ1dHbXdRRWI0REk3UjFCZ0llZXB1OG1UREx4YVgvVlFicGNDMlFWcnp0SEpCRkVIMXNGeDciLCJtYWMiOiJlM2YxNGJjYzhjN2JmOGIxZWZmZDkxNjE5NTQ2MTk3N2U3NGZiOWQ5N2M5N2ZkMzg4NWE3MTk5NGUyYWYwMzU0IiwidGFnIjoiIn0%3D; expires=Sun, 18 May 2025 15:12:44 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6ImxhNCtYUWprdUVXSWYxWXkwNmVYOFE9PSIsInZhbHVlIjoiZ1Z2QWx6MXdwYkFsQ0lUY3J1aEYvOWdxZ1d1TnBFb0tjWUlhSFp5aE02T3BKTzZZb1piakZpYzB0RkpPVVBvKzlnQ0NXR" 1 => "laravel_session=eyJpdiI6Im9PWDRsYllyR2FBRTRobXpMc1ZVaEE9PSIsInZhbHVlIjoiTmxsamNrY2FTQ2lQTlY2WXFjbTAvZXNhTytVVkYyZEhJYWJxY0xFZHN4dnhQVHZWcmxZUGFtUG91NjBrTGdmYjVFazlNcW8za1QyajRwMUNDVEZLakRPekNwQTJ5bVUyMmhhZHJMOVRSY2IyY1lMNGJZNFR6K2NSSDUxeWMwZHEiLCJtYWMiOiI2NTJjN2Q4NjliYzdlNDU3ZGRkNTM1Y2Y3NDg0YWNkYjg2ZjExNzRlOWY2ZTA1Y2M0M2FjNzA4OGIzZWExMjQ2IiwidGFnIjoiIn0%3D; expires=Sun, 18 May 2025 15:12:44 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Im9PWDRsYllyR2FBRTRobXpMc1ZVaEE9PSIsInZhbHVlIjoiTmxsamNrY2FTQ2lQTlY2WXFjbTAvZXNhTytVVkYyZEhJYWJxY0xFZHN4dnhQVHZWcmxZUGFtUG91NjBrTGdmYjVF" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImxhNCtYUWprdUVXSWYxWXkwNmVYOFE9PSIsInZhbHVlIjoiZ1Z2QWx6MXdwYkFsQ0lUY3J1aEYvOWdxZ1d1TnBFb0tjWUlhSFp5aE02T3BKTzZZb1piakZpYzB0RkpPVVBvKzlnQ0NXRm02R25EQ1dHbXdRRWI0REk3UjFCZ0llZXB1OG1UREx4YVgvVlFicGNDMlFWcnp0SEpCRkVIMXNGeDciLCJtYWMiOiJlM2YxNGJjYzhjN2JmOGIxZWZmZDkxNjE5NTQ2MTk3N2U3NGZiOWQ5N2M5N2ZkMzg4NWE3MTk5NGUyYWYwMzU0IiwidGFnIjoiIn0%3D; expires=Sun, 18-May-2025 15:12:44 GMT; path=/XSRF-TOKEN=eyJpdiI6ImxhNCtYUWprdUVXSWYxWXkwNmVYOFE9PSIsInZhbHVlIjoiZ1Z2QWx6MXdwYkFsQ0lUY3J1aEYvOWdxZ1d1TnBFb0tjWUlhSFp5aE02T3BKTzZZb1piakZpYzB0RkpPVVBvKzlnQ0NXR" 1 => "laravel_session=eyJpdiI6Im9PWDRsYllyR2FBRTRobXpMc1ZVaEE9PSIsInZhbHVlIjoiTmxsamNrY2FTQ2lQTlY2WXFjbTAvZXNhTytVVkYyZEhJYWJxY0xFZHN4dnhQVHZWcmxZUGFtUG91NjBrTGdmYjVFazlNcW8za1QyajRwMUNDVEZLakRPekNwQTJ5bVUyMmhhZHJMOVRSY2IyY1lMNGJZNFR6K2NSSDUxeWMwZHEiLCJtYWMiOiI2NTJjN2Q4NjliYzdlNDU3ZGRkNTM1Y2Y3NDg0YWNkYjg2ZjExNzRlOWY2ZTA1Y2M0M2FjNzA4OGIzZWExMjQ2IiwidGFnIjoiIn0%3D; expires=Sun, 18-May-2025 15:12:44 GMT; path=/; httponlylaravel_session=eyJpdiI6Im9PWDRsYllyR2FBRTRobXpMc1ZVaEE9PSIsInZhbHVlIjoiTmxsamNrY2FTQ2lQTlY2WXFjbTAvZXNhTytVVkYyZEhJYWJxY0xFZHN4dnhQVHZWcmxZUGFtUG91NjBrTGdmYjVF" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "RMTGKm24H34QYcCo8b5ivkhxaeg5VSslqP8Kw0xf" "locale" => "en" "_previous" => array:1 [ "url" => "https://www.corspedia.com/en/courses/become-a-deep-reinforcement-learning-expert" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]