Install Minerva

About Minerva

Minerva is a volunteer-driven effort to archive Myrient entire collection before it goes offline.

What's new in 2.0.0

New Streamed Downloader: Tiny chunks of files are directly downloaded and streamed to the Minerva Server. Files are never kept on your machine. Leaderboard: https://firehose.minerva-archive.org/ Note: The backend is still very much a work-in-progress, expect downtime like you did before. Commits - 2b42421: Fix link to the correct pypi project page (Citrodata) #23 - 0d60201: Added configuration for setting the auth callback host and port (SpoopyTim) #22 - e39604a: Linted with ruff (SpoopyTim) #22 - 06e1335: WIP merge with main code of hyperscraper (rlaphoenix) - d77fbe5: Fully utilize multithreading, more error handling (rlaphoenix) - 6776282: Remove unused worker_thread and relevant code (rlaphoenix) - 387c1c9: Correct the chunk_size and job size values (rlaphoenix) - d72706b: Remove Job Cache system, new Hyperscraper cant rlly cache (rlaphoenix) - a6000fa: Fix is_downloaded check (rlaphoenix) - 8175a88: Update ws_message to communicate be crafted byte payloads (rlaphoenix) - 866eca9: Create new data classes for Websocket Messages, Bump Server version (rlaphoenix) - 1b70cb8: Create Job State dataclass, use ChunkInfo across code (rlaphoenix) - dffc1cd: Remove --max-cache-size (rlaphoenix) - 24b4173: Exit the download when its finished (i need sleep) (rlaphoenix) - d1fe520: maybe put the break in the right place (im going to bed rn) (rlaphoenix) - fb3aa95: Stop freezing on reconnect please thank you (rlaphoenix) - fa90207: Clear the event thing after a reconnect, so it requests new tasks (turai) - 4f7b669: Improve CI/CD (rlaphoenix) - 9e714dc: Add job size environment variabl...

Read release notes

Version history