0.5.4

0.5.4 (2025-02-05)

🚀 Features

• Add support use_incognito_pages for browser_launch_options in PlaywrightCrawler (#941) (eae3a33) by @Mantisus

🐛 Bug Fixes

• Fix session managment with retire (#947) (caee03f) by @Mantisus
• Fix templates - poetry-plugin-export version and camoufox template name (#952) (7addea6) by @Pijukatel
• Fix convert relative link to absolute in enqueue_links for response with redirect (#956) (694102e) by @Mantisus
• Fix CurlImpersonateHttpClient cookies handler (#946) (ed415c4) by @Mantisus

0.5.3

0.5.3 (2025-01-31)

🚀 Features

• Add keep_alive flag to crawler.__init__ (#921) (7a82d0c) by @Pijukatel
• Add block_requests helper for PlaywrightCrawler (#919) (1030459) by @Mantisus
• Return request handlers from decorator methods to allow further decoration (#934) (9ec0aae) by @mylank
• Add transform_request_function for enqueue_links (#923) (6b15957) by @Mantisus
• Add time_remaining_secs property to MIGRATING event data (#940) (b44501b) by @fnesveda
• Add LogisticalRegressionPredictor - rendering type predictor for adaptive crawling (#930) (8440499) by @Pijukatel

🐛 Bug Fixes

• Fix crawler not retrying user handler if there was timeout in the handler (#909) (f4090ef) by @Pijukatel
• Optimize memory consumption for HttpxHttpClient, fix proxy handling (#905) (d7ad480) by @Mantisus
• Fix BrowserPool and PlaywrightBrowserPlugin closure (#932) (997543d) by @Mantisus

0.5.2

0.5.2 (2025-01-17)

🐛 Bug Fixes

• Avoid use_state race conditions. Remove key argument to use_state (#868) (000b976) by @Pijukatel
• Restore proxy functionality for PlaywrightCrawler broken in v0.5 (#889) (908c944) by @Mantisus
• Fix the usage of Configuration (#899) (0f1cf6f) by @vdusek

0.5.1

0.5.1 (2025-01-07)

🐛 Bug Fixes

• Make result of RequestList.is_empty independent of fetch_next_request calls (#876) (d50249e) by @janbuchar

0.5.0

0.5.0 (2025-01-02)

🚀 Features

• Add possibility to use None as no proxy in tiered proxies (#760) (0fbd017) by @Pijukatel
• Add use_state context method (#682) (868b41e) by @Mantisus
• Add pre-navigation hooks router to AbstractHttpCrawler (#791) (0f23205) by @Pijukatel
• Add example of how to integrate Camoufox into PlaywrightCrawler (#789) (246cfc4) by @Pijukatel
• Expose event types, improve on/emit signature, allow parameterless listeners (#800) (c102c4c) by @janbuchar
• Add stop method to BasicCrawler (#807) (6d01af4) by @Pijukatel
• Add html_to_text helper function (#792) (2b9d970) by @Pijukatel
• [breaking] Implement RequestManagerTandem, remove add_request from RequestList, accept any iterable in RequestList constructor (#777) (4172652) by @janbuchar

🐛 Bug Fixes

• Fix circular import in KeyValueStore (#805) (8bdf49d) by @Mantisus
• [breaking] Refactor service usage to rely on service_locator (#691) (1d31c6c) by @vdusek
• Pass verify in httpx client (#802) (074d083) by @Mantisus
• Fix page_options for PlaywrightBrowserPlugin (#796) (bd3bdd4) by @Mantisus
• Fix event migrating handler in RequestQueue (#825) (fd6663f) by @Mantisus
• Respect user configuration for work with status codes (#812) (8daf4bd) by @Mantisus
• abort-on-error for successive runs (#834) (0cea673) by @Mantisus
• Relax ServiceLocator restrictions (#837) (aa3667f) by @janbuchar
• Fix typo in exports (#841) (8fa6ac9) by @janbuchar

Refactor

• [breaking] Refactor HttpCrawler, BeautifulSoupCrawler, ParselCrawler inheritance (#746) (9d3c269) by @Pijukatel
• [breaking] Remove json_ and order_no from Request (#788) (5381d13) by @Mantisus
• [breaking] Rename PwPreNavContext to PwPreNavCrawlingContext (#827) (84b61a3) by @vdusek
• [breaking] Rename PlaywrightCrawler kwargs: browser_options, page_options (#831) (ffc6048) by @Pijukatel
• [breaking] Update the crawlers & storage clients structure (#828) (0ba04d1) by @vdusek

0.4.5

0.4.5 (2024-12-06)

🚀 Features

• Improve project bootstrapping (#538) (367899c) by @janbuchar

🐛 Bug Fixes

• Add upper bound of HTTPX version (#775) (b59e34d) by @vdusek
• Fix incorrect use of desired concurrency ratio (#780) (d1f8bfb) by @Pijukatel
• Remove pydantic constraint <2.10.0 and update timedelta validator, serializer type hints (#757) (c0050c0) by @Pijukatel

0.4.4

0.4.4 (2024-11-29)

🚀 Features

• Expose browser_options and page_options to PlaywrightCrawler (#730) (dbe85b9) by @vdusek
• Add abort_on_error property (#731) (6dae03a) by @Mantisus

🐛 Bug Fixes

• Fix init of context managers and context handling in BasicCrawler (#714) (486fe6d) by @vdusek

0.4.3

0.4.3 (2024-11-21)

🐛 Bug Fixes

• Pydantic 2.10.0 issues (#716) (8d8b3fc) by @Pijukatel

0.4.2

0.4.2 (2024-11-20)

🐛 Bug Fixes

• Respect custom HTTP headers in PlaywrightCrawler (#685) (a84125f) by @Mantisus
• Fix serialization payload in Request. Fix Docs for Post Request (#683) (e8b4d2d) by @Mantisus
• Accept string payload in the Request constructor (#697) (19f5add) by @vdusek
• Fix snapshots handling (#692) (4016c0d) by @Pijukatel

0.4.1

0.4.1 (2024-11-11)

🚀 Features

• Add max_crawl_depth option to BasicCrawler (#637) (77deaa9) by @Prathamesh010
• Add BeautifulSoupParser type alias (#674) (b2cf88f) by @Pijukatel

🐛 Bug Fixes

• Fix total_size usage in memory size monitoring (#661) (c2a3239) by @janbuchar
• Add HttpHeaders to module exports (#664) (f0c5ca7) by @vdusek
• Fix unhandled ValueError in request handler result processing (#666) (0a99d7f) by @janbuchar
• Fix BaseDatasetClient.iter_items type hints (#680) (a968b1b) by @Pijukatel