Computer Science / Machine Learning

Production Machine Learning Systems

Brought by: Coursera

Overview

In this course, we dive into the components and best practices of building high-performing ML systems in production environments.

We cover some of the most common considerations behind building these systems, e.g. static training, dynamic training, static inference, dynamic inference, distributed TensorFlow, and TPUs.

This course is devoted to exploring the characteristics that make for a good ML system beyond its ability to make good predictions.

Syllabus

  • Introduction to Advanced Machine Learning on Google Cloud
    • This module previews the topics covered in the course and how to use Qwiklabs to complete each of your labs using Google Cloud.
  • Architecting Production ML Systems
    • This module explores what else a production ML system needs to do and how to meet those needs. You review how to make important, high-level, design decisions around training and model serving need to make in order to get the right performance profile for your model.
  • Designing Adaptable ML Systems
    • In this module, you learn how to recognize the ways that our model is dependent on our data, make cost-conscious engineering decisions, know when to roll back our models to earlier versions, debug the causes of observed model behavior and implement a pipeline that is immune to one type of dependency.
  • Designing High-Performance ML Systems
    • In this module, you identify performance considerations for machine learning models.
      Machine learning models are not all identical. For some models, you focus on improving I/O performance, and on others, you focus on squeezing out more computational speed.
  • Building Hybrid ML Systems
    • Understand the tools and systems available and when to leverage hybrid machine learning models.
  • Summary
    • This module reviews what you learned in this course.

Taught by

Google Cloud Training

Computer Science / Machine Learning
Production Machine Learning Systems
Go to course

Production Machine Learning Systems

Brought by: Coursera

  • Coursera
  • Free
  • English
  • Certificate Available
  • Available at any time
  • All
  • English
MessagesTimelineExceptionsViews14RouteQueries7Models6GateSessionRequest
8.1.2PHP Version887msRequest Duration2MBMemory UsageGET en/courses/{slug}Route
    • Booting (568ms)
    • Application (316ms)
    • 1 x Booting (64.07%)
      568.27ms
      1 x Application (35.67%)
      316.38ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET en/courses/{slug}
      middleware
      web, localize:en
      controller
      App\Http\Controllers\CourseController@show
      as
      en.courses.show
      namespace
      prefix
      /en
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      7 statements were executed8.52ms
      corspedia
      • select * from `courses` where `slug_en` = 'production-machine-learning-systems' limit 1
        6.05ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. production-machine-learning-systems
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-06-15 18:04:01' where `id` = 300
        1.09ms/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-06-15 18:04:01
        • 1. 300
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)
        210μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `institutions` where `institutions`.`id` in (54) and `institutions`.`deleted_at` is null
        230μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null
        190μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 294 limit 1
        570μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 294
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Institution
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        GQRlPKOlai0JZOIZ4Fg8m9mHmF0JAbux9pF1FcBv
        locale
        en
        _previous
        array:1 [ "url" => "https://www.corspedia.com/en/courses/production-machine-learning-systems" ]
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /en/courses/production-machine-learning-systems
        status_code
        200
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        request_request
        []
        request_headers
          0 of 0   
        array:24 [▼
  "cf-ipcountry" => array:1 [▶
    0 => "US"
  ]
  "cf-connecting-ip" => array:1 [▶
    0 => "216.73.216.21"
  ]
  "cdn-loop" => array:1 [▶
    0 => "cloudflare; loops=1"
  ]
  "x-forwarded-proto" => array:1 [▶
    0 => "https"
  ]
  "x-forwarded-for" => array:1 [▶
    0 => "216.73.216.21"
  ]
  "sec-fetch-site" => array:1 [▶
    0 => "none"
  ]
  "accept" => array:1 [▶
    0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  ]
  "user-agent" => array:1 [▶
    0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  ]
  "upgrade-insecure-requests" => array:1 [▶
    0 => "1"
  ]
  "sec-ch-ua-platform" => array:1 [▶
    0 => ""Windows""
  ]
  "sec-ch-ua-mobile" => array:1 [▶
    0 => "?0"
  ]
  "sec-ch-ua" => array:1 [▶
    0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99""
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "sec-fetch-dest" => array:1 [▶
    0 => "document"
  ]
  "cf-ray" => array:1 [▶
    0 => "9503fcc85aae224c-ORD"
  ]
  "accept-encoding" => array:1 [▶
    0 => "gzip, br"
  ]
  "priority" => array:1 [▶
    0 => "u=0, i"
  ]
  "sec-fetch-user" => array:1 [▶
    0 => "?1"
  ]
  "sec-fetch-mode" => array:1 [▶
    0 => "navigate"
  ]
  "cf-visitor" => array:1 [▶
    0 => "{"scheme":"https"}"
  ]
  "host" => array:1 [▶
    0 => "www.corspedia.com"
  ]
  "content-length" => array:1 [▶
    0 => ""
  ]
  "content-type" => array:1 [▶
    0 => ""
  ]
]
        request_server
          0 of 0   
        array:50 [▼
  "USER" => "www-data"
  "HOME" => "/var/www"
  "HTTP_CF_IPCOUNTRY" => "US"
  "HTTP_CF_CONNECTING_IP" => "216.73.216.21"
  "HTTP_CDN_LOOP" => "cloudflare; loops=1"
  "HTTP_X_FORWARDED_PROTO" => "https"
  "HTTP_X_FORWARDED_FOR" => "216.73.216.21"
  "HTTP_SEC_FETCH_SITE" => "none"
  "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  "HTTP_UPGRADE_INSECURE_REQUESTS" => "1"
  "HTTP_SEC_CH_UA_PLATFORM" => ""Windows""
  "HTTP_SEC_CH_UA_MOBILE" => "?0"
  "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99""
  "HTTP_CACHE_CONTROL" => "no-cache"
  "HTTP_PRAGMA" => "no-cache"
  "HTTP_SEC_FETCH_DEST" => "document"
  "HTTP_CF_RAY" => "9503fcc85aae224c-ORD"
  "HTTP_ACCEPT_ENCODING" => "gzip, br"
  "HTTP_PRIORITY" => "u=0, i"
  "HTTP_SEC_FETCH_USER" => "?1"
  "HTTP_SEC_FETCH_MODE" => "navigate"
  "HTTP_CF_VISITOR" => "{"scheme":"https"}"
  "HTTP_HOST" => "www.corspedia.com"
  "REDIRECT_STATUS" => "200"
  "SERVER_NAME" => "corspedia.com"
  "SERVER_PORT" => "443"
  "SERVER_ADDR" => "141.95.147.152"
  "REMOTE_USER" => ""
  "REMOTE_PORT" => "40916"
  "REMOTE_ADDR" => "172.71.254.184"
  "SERVER_SOFTWARE" => "nginx/1.18.0"
  "GATEWAY_INTERFACE" => "CGI/1.1"
  "HTTPS" => "on"
  "REQUEST_SCHEME" => "https"
  "SERVER_PROTOCOL" => "HTTP/2.0"
  "DOCUMENT_ROOT" => "/var/www/corspedia/public"
  "DOCUMENT_URI" => "/index.php"
  "REQUEST_URI" => "/en/courses/production-machine-learning-systems"
  "SCRIPT_NAME" => "/index.php"
  "CONTENT_LENGTH" => ""
  "CONTENT_TYPE" => ""
  "REQUEST_METHOD" => "GET"
  "QUERY_STRING" => ""
  "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php"
  "PATH_INFO" => ""
  "FCGI_ROLE" => "RESPONDER"
  "PHP_SELF" => "/index.php"
  "REQUEST_TIME_FLOAT" => 1750010640.9596
  "REQUEST_TIME" => 1750010640
]
        request_cookies
        []
        response_headers
          0 of 0   
        array:5 [▼
  "content-type" => array:1 [▶
    0 => "text/html; charset=UTF-8"
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache, private"
  ]
  "date" => array:1 [▶
    0 => "Sun, 15 Jun 2025 18:04:01 GMT"
  ]
  "set-cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IlpoYnUyREgxb0w3UEV2TDR2S1h6ZWc9PSIsInZhbHVlIjoiTCtOSVVZTHJkK0ZjYnBadGFhS2RYNkJsZXowU0FkcGgrZVhUcjVNTXFtNXlmc0Fvc0FSUG1VQ1JpTXZCUkNkZnBRcWNPbks4cklVak95MXU5bXdDQlQwaGhZK09yN3dwTklPSEtBREpybmE1Qy9GVXVVZUJ2VjFxNkRrdi9NeFIiLCJtYWMiOiJmNmQxYjI1NmQwOWMwZmRmMzc1Yjk5MDFjZjBhZWJmODJiOWZmNjUzOTdiMjcwNDc4YTUwNzdkMWQ3NjYxYzQzIiwidGFnIjoiIn0%3D; expires=Sun, 15 Jun 2025 20:04:01 GMT; Max-Age=7200; path=/; samesite=lax ◀XSRF-TOKEN=eyJpdiI6IlpoYnUyREgxb0w3UEV2TDR2S1h6ZWc9PSIsInZhbHVlIjoiTCtOSVVZTHJkK0ZjYnBadGFhS2RYNkJsZXowU0FkcGgrZVhUcjVNTXFtNXlmc0Fvc0FSUG1VQ1JpTXZCUkNkZnBRcWNPb ▶"
    1 => "laravel_session=eyJpdiI6ImlUY1VLblA5SXlBYjY4RDdVLzdQQmc9PSIsInZhbHVlIjoiK1pudW51QjdTaGFPa2g4RGpJaTJaRFNXaFhUNUJvbHZ2Z25ydVlMSnVSWUZGZnZ0L0hEdmdMcjNMVlpYZGkvZDVWd0NUMWpFaEJJTTdhVmtVMFJ5TkJ6ekZTTDBlRnd0clJnWFp3S092VWU4QjdvYnZVRkZpNUpzM09DM0xTeWsiLCJtYWMiOiJiYjg4MjA1NTZhY2Y0YjZjMGFmZDlhYjcwYjczYzczZTY0NTFhZmI0ZTVmN2E5ODU0YmVlMjRiOWRkZjI1MTBlIiwidGFnIjoiIn0%3D; expires=Sun, 15 Jun 2025 20:04:01 GMT; Max-Age=7200; path=/; httponly; samesite=lax ◀laravel_session=eyJpdiI6ImlUY1VLblA5SXlBYjY4RDdVLzdQQmc9PSIsInZhbHVlIjoiK1pudW51QjdTaGFPa2g4RGpJaTJaRFNXaFhUNUJvbHZ2Z25ydVlMSnVSWUZGZnZ0L0hEdmdMcjNMVlpYZGkvZDVW ▶"
  ]
  "Set-Cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IlpoYnUyREgxb0w3UEV2TDR2S1h6ZWc9PSIsInZhbHVlIjoiTCtOSVVZTHJkK0ZjYnBadGFhS2RYNkJsZXowU0FkcGgrZVhUcjVNTXFtNXlmc0Fvc0FSUG1VQ1JpTXZCUkNkZnBRcWNPbks4cklVak95MXU5bXdDQlQwaGhZK09yN3dwTklPSEtBREpybmE1Qy9GVXVVZUJ2VjFxNkRrdi9NeFIiLCJtYWMiOiJmNmQxYjI1NmQwOWMwZmRmMzc1Yjk5MDFjZjBhZWJmODJiOWZmNjUzOTdiMjcwNDc4YTUwNzdkMWQ3NjYxYzQzIiwidGFnIjoiIn0%3D; expires=Sun, 15-Jun-2025 20:04:01 GMT; path=/ ◀XSRF-TOKEN=eyJpdiI6IlpoYnUyREgxb0w3UEV2TDR2S1h6ZWc9PSIsInZhbHVlIjoiTCtOSVVZTHJkK0ZjYnBadGFhS2RYNkJsZXowU0FkcGgrZVhUcjVNTXFtNXlmc0Fvc0FSUG1VQ1JpTXZCUkNkZnBRcWNPb ▶"
    1 => "laravel_session=eyJpdiI6ImlUY1VLblA5SXlBYjY4RDdVLzdQQmc9PSIsInZhbHVlIjoiK1pudW51QjdTaGFPa2g4RGpJaTJaRFNXaFhUNUJvbHZ2Z25ydVlMSnVSWUZGZnZ0L0hEdmdMcjNMVlpYZGkvZDVWd0NUMWpFaEJJTTdhVmtVMFJ5TkJ6ekZTTDBlRnd0clJnWFp3S092VWU4QjdvYnZVRkZpNUpzM09DM0xTeWsiLCJtYWMiOiJiYjg4MjA1NTZhY2Y0YjZjMGFmZDlhYjcwYjczYzczZTY0NTFhZmI0ZTVmN2E5ODU0YmVlMjRiOWRkZjI1MTBlIiwidGFnIjoiIn0%3D; expires=Sun, 15-Jun-2025 20:04:01 GMT; path=/; httponly ◀laravel_session=eyJpdiI6ImlUY1VLblA5SXlBYjY4RDdVLzdQQmc9PSIsInZhbHVlIjoiK1pudW51QjdTaGFPa2g4RGpJaTJaRFNXaFhUNUJvbHZ2Z25ydVlMSnVSWUZGZnZ0L0hEdmdMcjNMVlpYZGkvZDVW ▶"
  ]
]
        session_attributes
          0 of 0   
        array:5 [▼
  "_token" => "GQRlPKOlai0JZOIZ4Fg8m9mHmF0JAbux9pF1FcBv"
  "locale" => "en"
  "_previous" => array:1 [▶
    "url" => "https://www.corspedia.com/en/courses/production-machine-learning-systems"
  ]
  "_flash" => array:2 [▶
    "old" => []
    "new" => []
  ]
  "PHPDEBUGBAR_STACK_DATA" => []
]