Sparse Representations in Signal and Image Processing: Fundamentals

بواسطة: edX

Overview

This course introduces the fundamentals of the field of sparse representations, starting with its theoretical concepts, and systematically presenting its key achievements. We will touch on theory and numerical algorithms.

Modeling data is the way we - scientists - believe that information should be explained and handled. Indeed, models play a central role in practically every task in signal and image processing. Sparse representation theory puts forward an emerging, highly effective, and universal such model. Its core idea is the description of the data as a linear combination of few building blocks - atoms - taken from a pre-defined dictionary of such fundamental elements.

A series of theoretical problems arise in deploying this seemingly simple model to data sources, leading to fascinating new results in linear algebra, approximation theory, optimization, and machine learning. In this course you will learn of these achievements, which serve as the foundations for a revolution that took place in signal and image processing in recent years.

Syllabus

This program is composed from two separate parts:

1.Part 1: Sparse Representations in Signal and Image Processing: Fundamentals.

2.Part 2: Sparse Representations in Image Processing: From Theory to Practice.

While we recommend taking both courses, each of them can be taken independently of the other. The duration of each course is five weeks, and each part includes: (i) knowledge-check questions and discussions, (ii) series of quizzes, and (iii) Matlab programming projects. Each course will be graded separately, using the average grades of the questions/discussions [K] quizzes [Q], and projects [P], by Final-Grade = 0.1K + 0.5Q + 0.4P.

The following includes more details of the topics we will cover in the first course:

  • Overview of Sparseland, including mathematical warm-up and intro to L1-minimization.

  • Seeking sparse solutions: the L0 norm and P0 problem.

  • Theoretical analysis of the Two-Ortho case of P0, including definitions of Spark and Mutual-Coherence.

  • Theoretical analysis of the general case of the P0 problem.

  • Greedy pursuit algorithms including: Thresholding (THR), Orthogonal Matching Pursuit (OMP) and its variants.

  • Relaxation pursuit algorithms including Basis Pursuit (BP).

  • Theoretical guarantees of pursuit algorithms: THR, OMP and BP.

  • Practical tools to solve approximate problems, including exact solution of unitary case, Iterative Re-weighted Least Squares algorithm (IRLS) and Alternating Direction Method of Multipliers (ADMM).

  • Theoretical guarantees to approximate solutions including definition of Restricted Isometry Property (RIP) and pursuit algorithms' stability.

Taught by

Michael Elad and Yaniv Romano

Sparse Representations in Signal and Image Processing: Fundamentals
الذهاب الي الدورة

Sparse Representations in Signal and Image Processing: Fundamentals

بواسطة: edX

  • edX
  • مجانية
  • الإنجليزية
  • متاح شهادة
  • أيام محددة
  • advanced
  • English
8.1.2PHP Version838msRequest Duration2MBMemory UsageGET ar/الدورات/{slug}Route
    • Booting (479ms)
    • Application (357ms)
    • 1 x Booting (57.15%)
      478.89ms
      1 x Application (42.62%)
      357.17ms
      14 templates were rendered
      • public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
        Params
        0
        course
        1
        links
        2
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        classes
      • public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
        6
        route
        7
        title
      • public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
        Params
        0
        __env
        1
        app
        2
        errors
        3
        course
        4
        links
        5
        config
      uri
      GET ar/الدورات/{slug}
      middleware
      web, localize:ar
      controller
      App\Http\Controllers\CourseController@show
      as
      ar.courses.show
      namespace
      prefix
      /ar
      where
      file
      app/Http/Controllers/CourseController.php:17-35
      6 statements were executed13.12ms
      • select * from `courses` where `slug_ar` = 'sparse-representations-in-signal-and-image-processing:-fundamentals' limit 1
        11.29ms/app/Http/Controllers/CourseController.php:20corspedia
        Metadata
        Bindings
        • 0. sparse-representations-in-signal-and-image-processing:-fundamentals
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:20
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-07-27 15:12:11' where `id` = 2487
        710μs/app/Http/Controllers/CourseController.php:21corspedia
        Metadata
        Bindings
        • 0. 2025-07-27 15:12:11
        • 1. 2487
        Backtrace
        • 17. /app/Http/Controllers/CourseController.php:21
        • 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (19)
        300μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)
        240μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 25. /app/Http/Controllers/CourseController.php:23
        • 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `providers` where `providers`.`id` in (1) and `providers`.`deleted_at` is null
        290μs/app/Http/Controllers/CourseController.php:23corspedia
        Metadata
        Backtrace
        • 20. /app/Http/Controllers/CourseController.php:23
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43
        • 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260
        • 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205
      • select * from `html_files` where `html_files`.`id` = 2478 limit 1
        290μs/app/Models/Course.php:84corspedia
        Metadata
        Bindings
        • 0. 2478
        Backtrace
        • 21. /app/Models/Course.php:84
        • 28. view::public.courses.show:29
        • 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125
        • 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58
        • 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72
      App\Models\HtmlFile
      1
      App\Models\Provider
      1
      App\Models\Topic
      1
      App\Models\Subject
      1
      App\Models\Course
      1
        _token
        CrRzDCzsOjkrVvHjExBPYcw1VsFN1RutUSfO0zwd
        locale
        ar
        _previous
        array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/sparse...
        _flash
        array:2 [ "old" => [] "new" => [] ]
        PHPDEBUGBAR_STACK_DATA
        []
        path_info
        /ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/sparse-representations-in-signal-and-image-processing:-fundamentals
        status_code
        200
        
        status_text
        OK
        format
        html
        content_type
        text/html; charset=UTF-8
        request_query
        []
        
        request_request
        []
        
        request_headers
        0 of 0
        array:24 [ "cf-ipcountry" => array:1 [ 0 => "US" ] "cf-connecting-ip" => array:1 [ 0 => "216.73.216.94" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "x-forwarded-for" => array:1 [ 0 => "216.73.216.94" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "cf-ray" => array:1 [ 0 => "965d12d0cbc33a06-YYZ" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "priority" => array:1 [ 0 => "u=0, i" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "host" => array:1 [ 0 => "www.corspedia.com" ] "content-length" => array:1 [ 0 => "" ] "content-type" => array:1 [ 0 => "" ] ]
        request_server
        0 of 0
        array:50 [ "USER" => "www-data" "HOME" => "/var/www" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_CF_CONNECTING_IP" => "216.73.216.94" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_X_FORWARDED_FOR" => "216.73.216.94" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_CF_RAY" => "965d12d0cbc33a06-YYZ" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_PRIORITY" => "u=0, i" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_HOST" => "www.corspedia.com" "REDIRECT_STATUS" => "200" "SERVER_NAME" => "corspedia.com" "SERVER_PORT" => "443" "SERVER_ADDR" => "141.95.147.152" "REMOTE_USER" => "" "REMOTE_PORT" => "45988" "REMOTE_ADDR" => "172.69.214.44" "SERVER_SOFTWARE" => "nginx/1.18.0" "GATEWAY_INTERFACE" => "CGI/1.1" "HTTPS" => "on" "REQUEST_SCHEME" => "https" "SERVER_PROTOCOL" => "HTTP/2.0" "DOCUMENT_ROOT" => "/var/www/corspedia/public" "DOCUMENT_URI" => "/index.php" "REQUEST_URI" => "/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/sparse-representations-in-signal-and-image-processing:-fundamentals" "SCRIPT_NAME" => "/index.php" "CONTENT_LENGTH" => "" "CONTENT_TYPE" => "" "REQUEST_METHOD" => "GET" "QUERY_STRING" => "" "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php" "PATH_INFO" => "" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1753629130.6087 "REQUEST_TIME" => 1753629130 ]
        request_cookies
        []
        
        response_headers
        0 of 0
        array:5 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "no-cache, private" ] "date" => array:1 [ 0 => "Sun, 27 Jul 2025 15:12:11 GMT" ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IkRnNTRLTXlwQ0V3SzZHNHBkSXN5SUE9PSIsInZhbHVlIjoiY3lkTDFab3ExWE1sVnFLSVdPeVJRcXJpbE9WeWV6K0Z6cVpzbVU2ZXphbXplcEpIRk1HWTBlV0ZReGdQWWU2SGp0YUxwaHNXTE9pV0tnS2VpYjlFeDRTM0hlbG5xcUZGK0hPWXNPSlFHWEZ6bURvZXV1QnBabTBoK0orcVpzaEEiLCJtYWMiOiIxZTA1NTljNzhlMGI0NjgwZWZjMzYzYzQ4OGJkMzZlNzc4NDNlNGVhNGQ2ZGUxZTkyMWM1MmExMjEzOThlODhjIiwidGFnIjoiIn0%3D; expires=Sun, 27 Jul 2025 17:12:11 GMT; Max-Age=7200; path=/; samesite=laxXSRF-TOKEN=eyJpdiI6IkRnNTRLTXlwQ0V3SzZHNHBkSXN5SUE9PSIsInZhbHVlIjoiY3lkTDFab3ExWE1sVnFLSVdPeVJRcXJpbE9WeWV6K0Z6cVpzbVU2ZXphbXplcEpIRk1HWTBlV0ZReGdQWWU2SGp0YUxwa" 1 => "laravel_session=eyJpdiI6Iklod3FMN3F5ZXNJUFdFQTlUbmlSbHc9PSIsInZhbHVlIjoiZGpnTHpNWlRMa2RhRFVKWVBVRWxyQ2ExSkpvR2tKUjd3dlVsVmdtSDJscmxEUWxKTXd3TGdUaWIrN20rTXBxS2RaQUNqLytBejFYSS8xbGd3bU5HOU44STNFenV1VkwrQlpaOEZVMTNkR2k2clV0UWh1S1pqUFIrTEs1dHZFUU8iLCJtYWMiOiI4MmU0N2U3OGY2Y2ExNGQ0NzQ5YzNlNDMyZmZmOGM0OWMxMzBiNTMyOThlOTRhYWJiZGQ3Y2YwMTc3Njg2NWJjIiwidGFnIjoiIn0%3D; expires=Sun, 27 Jul 2025 17:12:11 GMT; Max-Age=7200; path=/; httponly; samesite=laxlaravel_session=eyJpdiI6Iklod3FMN3F5ZXNJUFdFQTlUbmlSbHc9PSIsInZhbHVlIjoiZGpnTHpNWlRMa2RhRFVKWVBVRWxyQ2ExSkpvR2tKUjd3dlVsVmdtSDJscmxEUWxKTXd3TGdUaWIrN20rTXBxS2Ra" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IkRnNTRLTXlwQ0V3SzZHNHBkSXN5SUE9PSIsInZhbHVlIjoiY3lkTDFab3ExWE1sVnFLSVdPeVJRcXJpbE9WeWV6K0Z6cVpzbVU2ZXphbXplcEpIRk1HWTBlV0ZReGdQWWU2SGp0YUxwaHNXTE9pV0tnS2VpYjlFeDRTM0hlbG5xcUZGK0hPWXNPSlFHWEZ6bURvZXV1QnBabTBoK0orcVpzaEEiLCJtYWMiOiIxZTA1NTljNzhlMGI0NjgwZWZjMzYzYzQ4OGJkMzZlNzc4NDNlNGVhNGQ2ZGUxZTkyMWM1MmExMjEzOThlODhjIiwidGFnIjoiIn0%3D; expires=Sun, 27-Jul-2025 17:12:11 GMT; path=/XSRF-TOKEN=eyJpdiI6IkRnNTRLTXlwQ0V3SzZHNHBkSXN5SUE9PSIsInZhbHVlIjoiY3lkTDFab3ExWE1sVnFLSVdPeVJRcXJpbE9WeWV6K0Z6cVpzbVU2ZXphbXplcEpIRk1HWTBlV0ZReGdQWWU2SGp0YUxwa" 1 => "laravel_session=eyJpdiI6Iklod3FMN3F5ZXNJUFdFQTlUbmlSbHc9PSIsInZhbHVlIjoiZGpnTHpNWlRMa2RhRFVKWVBVRWxyQ2ExSkpvR2tKUjd3dlVsVmdtSDJscmxEUWxKTXd3TGdUaWIrN20rTXBxS2RaQUNqLytBejFYSS8xbGd3bU5HOU44STNFenV1VkwrQlpaOEZVMTNkR2k2clV0UWh1S1pqUFIrTEs1dHZFUU8iLCJtYWMiOiI4MmU0N2U3OGY2Y2ExNGQ0NzQ5YzNlNDMyZmZmOGM0OWMxMzBiNTMyOThlOTRhYWJiZGQ3Y2YwMTc3Njg2NWJjIiwidGFnIjoiIn0%3D; expires=Sun, 27-Jul-2025 17:12:11 GMT; path=/; httponlylaravel_session=eyJpdiI6Iklod3FMN3F5ZXNJUFdFQTlUbmlSbHc9PSIsInZhbHVlIjoiZGpnTHpNWlRMa2RhRFVKWVBVRWxyQ2ExSkpvR2tKUjd3dlVsVmdtSDJscmxEUWxKTXd3TGdUaWIrN20rTXBxS2Ra" ] ]
        session_attributes
        0 of 0
        array:5 [ "_token" => "CrRzDCzsOjkrVvHjExBPYcw1VsFN1RutUSfO0zwd" "locale" => "ar" "_previous" => array:1 [ "url" => "https://www.corspedia.com/ar/%D8%A7%D9%84%D8%AF%D9%88%D8%B1%D8%A7%D8%AA/sparse-representations-in-signal-and-image-processing:-fundamentals" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]