Hyperparameter Optimization for Machine Learning

بواسطة: Udemy

Overview

Learn grid and random search, Bayesian optimization, multi-fidelity models, Optuna, Hyperopt, Scikit-Optimize & more.

What you'll learn:
  • Hyperparameter tunning and why it matters
  • Cross-validation and nested cross-validation
  • Hyperparameter tunning with Grid and Random search
  • Bayesian Optimisation
  • Tree-Structured Parzen Estimators, Population Based Training and SMAC
  • Hyperparameter tunning tools, i.e., Hyperopt, Optuna, Scikit-optimize, Keras Turner and others

Welcome to Hyperparameter Optimization for Machine Learning. In this course, you will learn multiple techniques to select the best hyperparameters and improve the performance of your machine learning models.


If you are regularly training machine learning models as a hobby or for your organization and want to improve the performance of your models, if you are keen to jump up in the leader board of a data science competition, or you simply want to learn more about how to tune hyperparameters of machine learning models, this course will show you how.


We'll take you step-by-step through engaging video tutorials and teach you everything you need to know about hyperparameter tuning. Throughout this comprehensive course, we cover almost every available approach to optimize hyperparameters, discussing their rationale, their advantages and shortcomings, the considerations to have when using the technique and their implementation in Python.


Specifically, you will learn:


  • What hyperparameters are and why tuning matters

  • The use of cross-validation and nested cross-validation for optimization

  • Grid search and Random search for hyperparameters

  • Bayesian Optimization

  • Tree-structured Parzen estimators

  • SMAC, Population Based Optimization and other SMBOalgorithms

  • How to implement these techniques with available open source packages including Hyperopt, Optuna, Scikit-optimize, Keras Turner and others.


By the end of the course, you will be able to decide which approach you would like to follow and carry it out with available open-source libraries.


This comprehensive machine learning course includes over 50 lectures spanning about 8 hours of video, and ALL topics include hands-on Python code examples which you can use for reference and for practice, and re-use in your own projects.


So what are you waiting for? Enroll today, learn how to tune the hyperparameters of your models and build better machine learning models.

Taught by

Soledad Galli

Hyperparameter Optimization for Machine Learning
الذهاب الي الدورة

Hyperparameter Optimization for Machine Learning

بواسطة: Udemy

  • Udemy
  • مدفوعة
  • الإنجليزية
  • متاح شهادة
  • متاح في أي وقت
  • intermediate
  • English
8.1.2PHP Version794msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (499ms)
    • Application (293ms)
    • 1 x Booting (62.88%)
      499.44ms
      1 x Application (36.86%)
      292.75ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed11.75ms
      • select * from `courses` where `slug_ar` = 'hyperparameter-optimization-for-machine-learning' limit 1
        10.18ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. hyperparameter-optimization-for-machine-learning
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-07-28 15:20:00' where `id` = 4305
        670μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-07-28 15:20:00
        • 1. 4305
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (118)
        230μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        180μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (51) and `providers`.`deleted_at` is null
        230μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 4296 limit 1
        260μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 4296
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        kY0D3aijzZ6J1tQF0TcvggMOewuL1UTwV1F8yBus
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/hyperp...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/hyperparameter-optimization-for-machine-learning
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "216.73.216.107" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "x-forwarded-for" => array:1 [ 0 => "216.73.216.107" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "96655ba71c40aaaa-YYZ" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "216.73.216.107" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_X_FORWARDED_FOR" => "216.73.216.107" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "96655ba71c40aaaa-YYZ" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "48032" "REMOTE_ADDR" => "172.70.80.189" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/hyperparameter-optimization-for-machine-learning" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1753715999.9174 "REQUEST_TIME" => 1753715999 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Mon, 28 Jul 2025 15:20:00 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImNTaEN6Zm9SbEVQZWpiUldLb0k1VEE9PSIsInZhbHVlIjoiamdMVmthcDN4ODFxbEQzT3Erc0FiV0d5RE53enZiWnRsR2s1RmtYRkM2NjNhZXd5QjM5ZEttUUJJbVZmdExDc1lFeFFOQXlLVWtVYlR0ZzRoQmFpMi9PclNhQkU0OUxGSHNxWjk0QUJQYlVBbXdXOU5uVlFuREpwNk81TUczY24iLCJtYWMiOiIyMjI0YWZjMGNiOGI4YjU4Nzc5N2ZlM2FiYjExY2JlZTcxOWMxZTFjNzNlMWZhMzliYzg4OTMyNGYwNGRiMzBkIiwidGFnIjoiIn0%3D; expires=Mon, 28 Jul 2025 17:20:00 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6ImNTaEN6Zm9SbEVQZWpiUldLb0k1VEE9PSIsInZhbHVlIjoiamdMVmthcDN4ODFxbEQzT3Erc0FiV0d5RE53enZiWnRsR2s1RmtYRkM2NjNhZXd5QjM5ZEttUUJJbVZmdExDc1lFeFFOQ" 1 => "laravel_session=eyJpdiI6ImswTnlFVDBRU2c2TGFrQ0V2aCsvUUE9PSIsInZhbHVlIjoiL1BvNlRXWjRqTmU2MkQ4QjVTd3NiSXA4NXBEVmZiT3p2MUhrV2VISnZwcHkrTTIzWEN3aGwxM2wzclpFN05yMXF5V05vNlBDT1dCb1BGaFZIL3hsR25OWjAyL0RIc0VZaXpHOFNOMlorNkRjUStXM01HQXAxNWJ0SlZ5TDNKYjAiLCJtYWMiOiI4MGU3NWI3YTVmMDg3MzRhMDNmZWQ4NzI5ZjkyMDdmNDk5MDFkMWMyYWMxOTE4MGI2ZWU1NThiMGQ5YmZmMTQwIiwidGFnIjoiIn0%3D; expires=Mon, 28 Jul 2025 17:20:00 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6ImswTnlFVDBRU2c2TGFrQ0V2aCsvUUE9PSIsInZhbHVlIjoiL1BvNlRXWjRqTmU2MkQ4QjVTd3NiSXA4NXBEVmZiT3p2MUhrV2VISnZwcHkrTTIzWEN3aGwxM2wzclpFN05yMXF5" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6ImNTaEN6Zm9SbEVQZWpiUldLb0k1VEE9PSIsInZhbHVlIjoiamdMVmthcDN4ODFxbEQzT3Erc0FiV0d5RE53enZiWnRsR2s1RmtYRkM2NjNhZXd5QjM5ZEttUUJJbVZmdExDc1lFeFFOQXlLVWtVYlR0ZzRoQmFpMi9PclNhQkU0OUxGSHNxWjk0QUJQYlVBbXdXOU5uVlFuREpwNk81TUczY24iLCJtYWMiOiIyMjI0YWZjMGNiOGI4YjU4Nzc5N2ZlM2FiYjExY2JlZTcxOWMxZTFjNzNlMWZhMzliYzg4OTMyNGYwNGRiMzBkIiwidGFnIjoiIn0%3D; expires=Mon, 28-Jul-2025 17:20:00 GMT; path=/XSRF-TOKEN=eyJpdiI6ImNTaEN6Zm9SbEVQZWpiUldLb0k1VEE9PSIsInZhbHVlIjoiamdMVmthcDN4ODFxbEQzT3Erc0FiV0d5RE53enZiWnRsR2s1RmtYRkM2NjNhZXd5QjM5ZEttUUJJbVZmdExDc1lFeFFOQ" 1 => "laravel_session=eyJpdiI6ImswTnlFVDBRU2c2TGFrQ0V2aCsvUUE9PSIsInZhbHVlIjoiL1BvNlRXWjRqTmU2MkQ4QjVTd3NiSXA4NXBEVmZiT3p2MUhrV2VISnZwcHkrTTIzWEN3aGwxM2wzclpFN05yMXF5V05vNlBDT1dCb1BGaFZIL3hsR25OWjAyL0RIc0VZaXpHOFNOMlorNkRjUStXM01HQXAxNWJ0SlZ5TDNKYjAiLCJtYWMiOiI4MGU3NWI3YTVmMDg3MzRhMDNmZWQ4NzI5ZjkyMDdmNDk5MDFkMWMyYWMxOTE4MGI2ZWU1NThiMGQ5YmZmMTQwIiwidGFnIjoiIn0%3D; expires=Mon, 28-Jul-2025 17:20:00 GMT; path=/; httponlylaravel_session=eyJpdiI6ImswTnlFVDBRU2c2TGFrQ0V2aCsvUUE9PSIsInZhbHVlIjoiL1BvNlRXWjRqTmU2MkQ4QjVTd3NiSXA4NXBEVmZiT3p2MUhrV2VISnZwcHkrTTIzWEN3aGwxM2wzclpFN05yMXF5" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "kY0D3aijzZ6J1tQF0TcvggMOewuL1UTwV1F8yBus" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/hyperparameter-optimization-for-machine-learning" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]