Computer Science / Machine Learning

Overview of Advanced Methods of Reinforcement Learning in Finance

Brought by: Coursera

Overview

In the last course of our specialization, Overview of Advanced Methods of Reinforcement Learning in Finance, we will take a deeper look into topics discussed in our third course, Reinforcement Learning in Finance.

In particular, we will talk about links between Reinforcement Learning, option pricing and physics, implications of Inverse Reinforcement Learning for modeling market impact and price dynamics, and perception-action cycles in Reinforcement Learning. Finally, we will overview trending and potential applications of Reinforcement Learning for high-frequency trading, cryptocurrencies, peer-to-peer lending, and more.

After taking this course, students will be able to
- explain fundamental concepts of finance such as market equilibrium, no arbitrage, predictability,
- discuss market modeling,
- Apply the methods of Reinforcement Learning to high-frequency trading, credit risk peer-to-peer lending, and cryptocurrencies trading.

Syllabus

Black-Scholes-Merton model, Physics and Reinforcement Learning
Reinforcement Learning for Optimal Trading and Market Modeling
Perception - Beyond Reinforcement Learning
Other Applications of Reinforcement Learning: P-2-P Lending, Cryptocurrency, etc.

Taught by

Igor Halperin

Computer Science / Machine Learning

Overview of Advanced Methods of Reinforcement Learning in Finance

Overview of Advanced Methods of Reinforcement Learning in Finance

Brought by: Coursera

Coursera
Free
English
Certificate Available
Available at any time
All
English, Arabic, French, Portuguese, German, Thai, Indonesian, Spanish, Kazakh, Hindi, Russian, Swedish, Korean, Greek, Italian, Chinese, Ukrainian, Japanese, Polish, Dutch, Turkish

Messages Timeline Exceptions Views14 Route Queries7 Models6 Gate Session Request

8.1.21.07s2MBGET en/courses/{slug}

Booting (693ms)
Application (376ms)
1 x Booting (64.67%)
692.55ms
1 x Application (35.08%)
375.69ms

14 templates were rendered

public.courses.show (resources/views/public/courses/show.blade.php)3bladefile
Params
0
course
1
links
2
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.courses.partials.details (resources/views/public/courses/partials/details.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.breadcrumbs (resources/views/public/courses/partials/breadcrumbs.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.courses.partials.heading (resources/views/public/courses/partials/heading.blade.php)7bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
classes
public.layouts.main (resources/views/public/layouts/main.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.meta (resources/views/public/layouts/partials/meta.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.layouts.partials.navbar (resources/views/public/layouts/partials/navbar.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.links (resources/views/public/auth/profile/partials/links.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.auth.profile.partials.link (resources/views/public/auth/profile/partials/link.blade.php)8bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config
6
route
7
title
public.layouts.partials.flash-session (resources/views/public/layouts/partials/flash-session.blade.php)6bladefile
Params
0
__env
1
app
2
errors
3
course
4
links
5
config

uri: GET en/courses/{slug}
middleware: web, localize:en
controller: App\Http\Controllers\CourseController@show
as: en.courses.show
namespace
prefix: /en
where
file: app/Http/Controllers/CourseController.php:17-35

7 statements were executed8.8ms

select * from `courses` where `slug_en` = 'overview-of-advanced-methods-of-reinforcement-learning-in-finance' limit 1

7.18ms/app/Http/Controllers/CourseController.php:20corspedia

Metadata
Bindings	0. overview-of-advanced-methods-of-reinforcement-learning-in-finance
Backtrace	17. /app/Http/Controllers/CourseController.php:20 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

update `courses` set `visitors` = `visitors` + 1, `courses`.`updated_at` = '2025-06-10 01:26:20' where `id` = 298

500μs/app/Http/Controllers/CourseController.php:21corspedia

Metadata
Bindings	0. 2025-06-10 01:26:20 1. 298
Backtrace	17. /app/Http/Controllers/CourseController.php:21 18. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `topic_id`, `slug_en`, `slug_ar` from `subjects` where `subjects`.`id` in (4)

220μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select `id`, `name_en`, `name_ar`, `slug_en`, `slug_ar` from `topics` where `topics`.`id` in (1)

170μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	25. /app/Http/Controllers/CourseController.php:23 26. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 27. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 28. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 29. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `institutions` where `institutions`.`id` in (32) and `institutions`.`deleted_at` is null

200μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `providers` where `providers`.`id` in (2) and `providers`.`deleted_at` is null

170μs/app/Http/Controllers/CourseController.php:23corspedia

Metadata
Backtrace	20. /app/Http/Controllers/CourseController.php:23 21. /vendor/laravel/framework/src/Illuminate/Routing/Controller.php:54 22. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:43 23. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:260 24. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:205

select * from `html_files` where `html_files`.`id` = 292 limit 1

360μs/app/Models/Course.php:84corspedia

Metadata
Bindings	0. 292
Backtrace	21. /app/Models/Course.php:84 28. view::public.courses.show:29 30. /vendor/laravel/framework/src/Illuminate/Filesystem/Filesystem.php:125 31. /vendor/laravel/framework/src/Illuminate/View/Engines/PhpEngine.php:58 32. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:72

App\Models\HtmlFile: 1
App\Models\Provider: 1
App\Models\Institution: 1
App\Models\Topic: 1
App\Models\Subject: 1
App\Models\Course: 1

_token: ac5PHVPTMgszTUq9GchmhmvDYNhZs4bCKyv1XETn
locale: en
_previous: array:1 [ "url" => "https://www.corspedia.com/en/courses/overview-of-advanced-methods-of-reinforce...
_flash: array:2 [ "old" => [] "new" => [] ]
PHPDEBUGBAR_STACK_DATA: []

path_info

/en/courses/overview-of-advanced-methods-of-reinforcement-learning-in-finance

status_code

status_text

OK

format

html

content_type

text/html; charset=UTF-8

request_query

[]

request_request

[]

request_headers

  0 of 0   
array:24 [▼
  "cf-ipcountry" => array:1 [▶
    0 => "US"
  ]
  "cf-connecting-ip" => array:1 [▶
    0 => "216.73.216.125"
  ]
  "cdn-loop" => array:1 [▶
    0 => "cloudflare; loops=1"
  ]
  "x-forwarded-proto" => array:1 [▶
    0 => "https"
  ]
  "x-forwarded-for" => array:1 [▶
    0 => "216.73.216.125"
  ]
  "sec-fetch-site" => array:1 [▶
    0 => "none"
  ]
  "accept" => array:1 [▶
    0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  ]
  "user-agent" => array:1 [▶
    0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  ]
  "upgrade-insecure-requests" => array:1 [▶
    0 => "1"
  ]
  "sec-ch-ua-platform" => array:1 [▶
    0 => ""Windows""
  ]
  "sec-ch-ua-mobile" => array:1 [▶
    0 => "?0"
  ]
  "sec-ch-ua" => array:1 [▶
    0 => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99""
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache"
  ]
  "pragma" => array:1 [▶
    0 => "no-cache"
  ]
  "sec-fetch-dest" => array:1 [▶
    0 => "document"
  ]
  "cf-ray" => array:1 [▶
    0 => "94d51472c9f8edc5-ORD"
  ]
  "accept-encoding" => array:1 [▶
    0 => "gzip, br"
  ]
  "priority" => array:1 [▶
    0 => "u=0, i"
  ]
  "sec-fetch-user" => array:1 [▶
    0 => "?1"
  ]
  "sec-fetch-mode" => array:1 [▶
    0 => "navigate"
  ]
  "cf-visitor" => array:1 [▶
    0 => "{"scheme":"https"}"
  ]
  "host" => array:1 [▶
    0 => "www.corspedia.com"
  ]
  "content-length" => array:1 [▶
    0 => ""
  ]
  "content-type" => array:1 [▶
    0 => ""
  ]
]

request_server

  0 of 0   
array:50 [▼
  "USER" => "www-data"
  "HOME" => "/var/www"
  "HTTP_CF_IPCOUNTRY" => "US"
  "HTTP_CF_CONNECTING_IP" => "216.73.216.125"
  "HTTP_CDN_LOOP" => "cloudflare; loops=1"
  "HTTP_X_FORWARDED_PROTO" => "https"
  "HTTP_X_FORWARDED_FOR" => "216.73.216.125"
  "HTTP_SEC_FETCH_SITE" => "none"
  "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7"
  "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
  "HTTP_UPGRADE_INSECURE_REQUESTS" => "1"
  "HTTP_SEC_CH_UA_PLATFORM" => ""Windows""
  "HTTP_SEC_CH_UA_MOBILE" => "?0"
  "HTTP_SEC_CH_UA" => ""Chromium";v="130", "HeadlessChrome";v="130", "Not?A_Brand";v="99""
  "HTTP_CACHE_CONTROL" => "no-cache"
  "HTTP_PRAGMA" => "no-cache"
  "HTTP_SEC_FETCH_DEST" => "document"
  "HTTP_CF_RAY" => "94d51472c9f8edc5-ORD"
  "HTTP_ACCEPT_ENCODING" => "gzip, br"
  "HTTP_PRIORITY" => "u=0, i"
  "HTTP_SEC_FETCH_USER" => "?1"
  "HTTP_SEC_FETCH_MODE" => "navigate"
  "HTTP_CF_VISITOR" => "{"scheme":"https"}"
  "HTTP_HOST" => "www.corspedia.com"
  "REDIRECT_STATUS" => "200"
  "SERVER_NAME" => "corspedia.com"
  "SERVER_PORT" => "443"
  "SERVER_ADDR" => "141.95.147.152"
  "REMOTE_USER" => ""
  "REMOTE_PORT" => "20204"
  "REMOTE_ADDR" => "172.69.58.214"
  "SERVER_SOFTWARE" => "nginx/1.18.0"
  "GATEWAY_INTERFACE" => "CGI/1.1"
  "HTTPS" => "on"
  "REQUEST_SCHEME" => "https"
  "SERVER_PROTOCOL" => "HTTP/2.0"
  "DOCUMENT_ROOT" => "/var/www/corspedia/public"
  "DOCUMENT_URI" => "/index.php"
  "REQUEST_URI" => "/en/courses/overview-of-advanced-methods-of-reinforcement-learning-in-finance"
  "SCRIPT_NAME" => "/index.php"
  "CONTENT_LENGTH" => ""
  "CONTENT_TYPE" => ""
  "REQUEST_METHOD" => "GET"
  "QUERY_STRING" => ""
  "SCRIPT_FILENAME" => "/var/www/corspedia/public/index.php"
  "PATH_INFO" => ""
  "FCGI_ROLE" => "RESPONDER"
  "PHP_SELF" => "/index.php"
  "REQUEST_TIME_FLOAT" => 1749518779.602
  "REQUEST_TIME" => 1749518779
]

request_cookies

[]

response_headers

  0 of 0   
array:5 [▼
  "content-type" => array:1 [▶
    0 => "text/html; charset=UTF-8"
  ]
  "cache-control" => array:1 [▶
    0 => "no-cache, private"
  ]
  "date" => array:1 [▶
    0 => "Tue, 10 Jun 2025 01:26:20 GMT"
  ]
  "set-cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IkdTMC8vVC9NZ05POVlRQk9zNEl3a3c9PSIsInZhbHVlIjoiRVdHTFlGYUR3NENTVXVLQ2crNHIwSGpHSFpPblA4NG9hTWYrLzkyT01lcU9JeGt5ZTRwYisvcnIvZ1VVRU1YZ1l0QWlnZ0FxZ1YvTFVneFpVS3NyRFVQbTJwTVhabExmNnhwZldiR241ZUtZWHBGVWJiM2RGQi8yN0ZHcWpMN1kiLCJtYWMiOiI5M2IxMmMzYjQzMjgxZmI5OTI3Yjc0ZWVjOWZiMWI1NjA2ZjE0NmI0ZWM2NGQxZjI0ZDE5MWY3ZWE2MDFhZjg1IiwidGFnIjoiIn0%3D; expires=Tue, 10 Jun 2025 03:26:20 GMT; Max-Age=7200; path=/; samesite=lax ◀XSRF-TOKEN=eyJpdiI6IkdTMC8vVC9NZ05POVlRQk9zNEl3a3c9PSIsInZhbHVlIjoiRVdHTFlGYUR3NENTVXVLQ2crNHIwSGpHSFpPblA4NG9hTWYrLzkyT01lcU9JeGt5ZTRwYisvcnIvZ1VVRU1YZ1l0QWlnZ ▶"
    1 => "laravel_session=eyJpdiI6IjhlMElXeE9QaXVITGFWcU9hQ2VSSGc9PSIsInZhbHVlIjoiQzFLdjh5aXZJd3NMbmJYb21WaWx1ZFhuSWR3amhoQXFTOW80bDc5cE5ISXRjQjM0Wjl4cHordGR4K29aZHFiblVrZE5NS1VQZ29naGFMeDdwK1N6VGVLaTJjaEtsdlQvOFd2K3JFY0plc0ROY0FRQ0ttYWNMZWFncytXVzkxVUkiLCJtYWMiOiJlOThkMGZhMTM1YjM3ZjNhZDIzMGU0YmJhMzU5M2UyZGY3Mjg1ZWFjNDBiZWI0MjRkNDRlNzQzN2NmZWY5NjQyIiwidGFnIjoiIn0%3D; expires=Tue, 10 Jun 2025 03:26:20 GMT; Max-Age=7200; path=/; httponly; samesite=lax ◀laravel_session=eyJpdiI6IjhlMElXeE9QaXVITGFWcU9hQ2VSSGc9PSIsInZhbHVlIjoiQzFLdjh5aXZJd3NMbmJYb21WaWx1ZFhuSWR3amhoQXFTOW80bDc5cE5ISXRjQjM0Wjl4cHordGR4K29aZHFiblVr ▶"
  ]
  "Set-Cookie" => array:2 [▶
    0 => "XSRF-TOKEN=eyJpdiI6IkdTMC8vVC9NZ05POVlRQk9zNEl3a3c9PSIsInZhbHVlIjoiRVdHTFlGYUR3NENTVXVLQ2crNHIwSGpHSFpPblA4NG9hTWYrLzkyT01lcU9JeGt5ZTRwYisvcnIvZ1VVRU1YZ1l0QWlnZ0FxZ1YvTFVneFpVS3NyRFVQbTJwTVhabExmNnhwZldiR241ZUtZWHBGVWJiM2RGQi8yN0ZHcWpMN1kiLCJtYWMiOiI5M2IxMmMzYjQzMjgxZmI5OTI3Yjc0ZWVjOWZiMWI1NjA2ZjE0NmI0ZWM2NGQxZjI0ZDE5MWY3ZWE2MDFhZjg1IiwidGFnIjoiIn0%3D; expires=Tue, 10-Jun-2025 03:26:20 GMT; path=/ ◀XSRF-TOKEN=eyJpdiI6IkdTMC8vVC9NZ05POVlRQk9zNEl3a3c9PSIsInZhbHVlIjoiRVdHTFlGYUR3NENTVXVLQ2crNHIwSGpHSFpPblA4NG9hTWYrLzkyT01lcU9JeGt5ZTRwYisvcnIvZ1VVRU1YZ1l0QWlnZ ▶"
    1 => "laravel_session=eyJpdiI6IjhlMElXeE9QaXVITGFWcU9hQ2VSSGc9PSIsInZhbHVlIjoiQzFLdjh5aXZJd3NMbmJYb21WaWx1ZFhuSWR3amhoQXFTOW80bDc5cE5ISXRjQjM0Wjl4cHordGR4K29aZHFiblVrZE5NS1VQZ29naGFMeDdwK1N6VGVLaTJjaEtsdlQvOFd2K3JFY0plc0ROY0FRQ0ttYWNMZWFncytXVzkxVUkiLCJtYWMiOiJlOThkMGZhMTM1YjM3ZjNhZDIzMGU0YmJhMzU5M2UyZGY3Mjg1ZWFjNDBiZWI0MjRkNDRlNzQzN2NmZWY5NjQyIiwidGFnIjoiIn0%3D; expires=Tue, 10-Jun-2025 03:26:20 GMT; path=/; httponly ◀laravel_session=eyJpdiI6IjhlMElXeE9QaXVITGFWcU9hQ2VSSGc9PSIsInZhbHVlIjoiQzFLdjh5aXZJd3NMbmJYb21WaWx1ZFhuSWR3amhoQXFTOW80bDc5cE5ISXRjQjM0Wjl4cHordGR4K29aZHFiblVr ▶"
  ]
]

session_attributes

  0 of 0   
array:5 [▼
  "_token" => "ac5PHVPTMgszTUq9GchmhmvDYNhZs4bCKyv1XETn"
  "locale" => "en"
  "_previous" => array:1 [▶
    "url" => "https://www.corspedia.com/en/courses/overview-of-advanced-methods-of-reinforcement-learning-in-finance"
  ]
  "_flash" => array:2 [▶
    "old" => []
    "new" => []
  ]
  "PHPDEBUGBAR_STACK_DATA" => []
]