Commit graph

15 commits

Author SHA1 Message Date
tantabus-oneiros
91b3baee34 Update civitai.ex
If mix is lying I will cry
2025-03-15 03:05:29 +01:00
tantabus-oneiros
66020ce8ac Update civitai.ex
Clean empty lines
2025-03-15 00:15:13 +01:00
tantabus-oneiros
1a90f8cdc4 Add CivitAI post scraper
Added a scraper for CivitAI posts. Only supports post URLs (not single images) due to API limitations. API also does not provide the "description" visible on the site itself. Meta information like model, prompt, seed, etc. not used as we do not (yet) has a way to store or show this neatly.
2025-03-14 21:26:25 +01:00
mdashlw
b768e75cf6 Handle bluesky's recordWithMedia 2025-02-11 08:13:06 +00:00
Liam
282b8b7322 Fix errors in bsky scraper 2024-11-15 08:55:33 -05:00
Yay295
88f58a5474 handle bluesky "handle" that is a "did" 2024-11-15 08:43:48 -05:00
Yay295
a08510f21e Add Bluesky scraper (#290)
* add bluesky scraper

* use com.atproto.sync.getBlob to get original bluesky image

* ignore data after bluesky post id

* fix json access and missing function

* fix bluesky fullsize image regex
2024-10-28 16:14:48 -04:00
Liam
967cbf7b24 Remove transport_opts workaround for SSL hosts due to upstream fix
Available in 27.0.1+ by https://github.com/erlang/otp/issues/8588
2024-08-16 13:42:08 -04:00
Liam
ad2b4b004c Work around verification failure for ssl roots using SHA-1 2024-06-21 08:53:23 -04:00
Liam
a344062d53 Update response header usages for list format 2024-06-20 19:49:19 -04:00
Liam
44c160b905 Remove extremely outdated redirect follower from DA scraper 2024-06-20 19:49:19 -04:00
Liam
6170e0b5dd Replace Tesla with Req 2024-06-19 23:35:44 -04:00
Liam
16e15e9c67 Add extra type and callback documentation 2024-06-18 15:06:01 -04:00
Liam
1eed44aa95 Fix scraper error with invalid hostname 2024-06-09 12:40:44 -04:00
Liam
c63bc41d8b Split out HTTP client interaction into PhilomenaProxy namespace 2024-06-02 19:26:00 -04:00