Backing up Spotify
annas-archive.li
We backed up Spotify (metadata and music files). It’s distributed in bulk torrents (~300TB). It’s the world’s first “preservation archive” for music which is fully open (meaning it can easily be mirrored by anyone with enough disk space), with 86 million music files, representing around 99.6% of listens.

We backed up Spotify (metadata and music files). It’s distributed in bulk torrents (~300TB), grouped by popularity.

This release includes the largest publicly available music metadata database with 256 million tracks and 186 million unique ISRCs.

It’s the world’s first “preservation archive” for music which is fully open (meaning it can easily be mirrored by anyone with enough disk space), with 86 million music files, representing around 99.6% of listens.

    • slappyfuck@lemmy.caEnglish
      11·
      23 days ago

      Omg if my girlfriend had $10k to give me for a server I could buy like a RAM or two!

  • GasMaskedLunatic@lemmy.dbzer0.comEnglish
    211·
    23 days ago

    I cannot fathom the legal fees that will be incurred if they release 99.6% of Spotify to the public for free. Holy fucking shit.

  • harc@szmer.infoEnglish
    8·
    23 days ago

    Would be interesting if someone checked what % of that archive is slopified.

    • ReallyActuallyFrankenstein@lemmynsfw.comEnglish
      3·
      23 days ago

      Honestly, this is the best time to snapshot it, because even with the slop already there, the exponential increase that’s about to happen will absolutely dwarf what’s there now.

  • Zombie@feddit.ukEnglish
    111·
    24 days ago

    After Meta scraped all their books they have the perfect defense now. All they have to say is “we’re training a music AI” and they’re apparently untouchable.

    • Signtist@bookwyr.meEnglish
      30·
      23 days ago

      Well, they have to say “we’re training a music AI” while slipping several million dollars into the pockets of the right people. Rich people don’t win legal battles by actually proving what they did isn’t illegal, they do it by discreetly paying people to say they did.

      • driving_crooner@lemmy.eco.brEnglish
        9·
        24 days ago

        Would love lmao. Just bought a second hand VDJ and I’m starting to experiment with mixxx, and I don’t know is the style I like (latincore and adjacents) or if the BPM detected of mixxx isn’t that good.

        • Rai@lemmy.dbzer0.comEnglish
          6·
          24 days ago

          Good on you for starting that up! I wish you much success in your mixing and/or producing journey!

    • mic_check_one_two@lemmy.dbzer0.comEnglish
      4·
      23 days ago

      Yes, and it hasn’t been easy to dig up until recently. There were a few ways to search the “hidden” metadata fields that Spotify uses internally. But it definitely hasn’t been easy or straightforward.

      Those hidden fields are how Spotify recommends similar artists. You have a few bands on repeat with specific instruments, chord progressions, and singer vocal range? Gee, maybe you’ll enjoy other bands that are similar to that…

    • infinitesunrise@slrpnk.netEnglish
      33·
      24 days ago

      Both. Per the SQL schema printed in the article, table track_audio_features has both fields tempo and key along with many other technicals. Worth checking out, it’s near the bottom of the page.

    • Lyra_Lycan@lemmy.blahaj.zoneEnglish
      4·
      23 days ago

      Step 1: Buy £6,000 worth of identical hard drives and a motherboard with 16 SATA ports. Or £12,000 worth and a RAID 1 server rig. Or £24,000 and RAID 6

      • Revan343@lemmy.caEnglish
        4·
        23 days ago

        You can get PCI cards to add more sata ports, they don’t all need to be on the motherboard

      • hedidwot@lemmynsfw.comEnglish
        1·
        18 days ago

        6k for 10TB?

        A Raspberry pi with a sata hat and 16TB hard disk could download and serve this for well under 500 quid.

        An off the shelf 4 bay NAS with 4x 6TB drives in raid 5 would give you 15TB or so formatted capacity with redundancy. That would easily be under 2k… Jeez grab 2 and sync contents to a second location… even a third location… Still under 6k.

    • Strawberry@lemmy.blahaj.zoneEnglish
      40·
      22 days ago

      I fucking love annas archive.

      Anna does seem rather insane though

      Edit: I was thinking of Alexandra Elbakyan, the creator of Sci-Hub

        • Strawberry@lemmy.blahaj.zoneEnglish
          92·
          22 days ago

          iirc her writings gave me the impression that she basically worships communism and famous soviet communist leaders in a vaguely religious way. I can go look again later and elaborate. It could just be the language barrier that gave me that impression.

          Edit: I was misremembering Alexandra Elbakyan, the creator of Sci-Hub, as Anna of Anna’s Archive. Oops

          • mirshafie@europe.pubEnglish
            71·
            23 days ago

            Down with the bourgeoisie

            Eat the rich

            Sodomize the land-owners

            Impale all people who have more than 25 reál in their pocket

            Literally murder all human beings regardless of their political beliefs

            • Strawberry@lemmy.blahaj.zoneEnglish
              2·
              22 days ago

              I went to look for a link for you and found that I was misremembering. I was thinking of Alexandra Elbakyan, the creator of Sci-Hub, one of the libraries that Anna’s Archive indexes. In case you’re curious about her, here’s an archive of her personal page on Sci-Hub