first I went to archive.org and searched for all pages under
https://twitter.com/EmileeSilvey.
Then I had to figure out how to open or download all those pages to see if they contained media. I found an app called wayback_machine_downloader, which I then used to fetch all the pages under
https://twitter.com/EmileeSilvey.
But then I had 583MB of webpages I had to search through... Doing all of this on a phone didn't make things easier either. Moving them all to the same folder was already difficult since they were all just named 'index.html' and ofc. android file explorers don't typically support auto-rename.. Or if they do, only for a few dozen or so files.
Eventually I got them all in the same folder. I renamed them all from html to txt.
Did
But then I found out Acode can't open txt files that big. So I used the command
Code:
grep -Ril "pbs.twimg.com/media"
To figure out which of the files had the Twitter photo url in their code. I then moved all those files into a different directory.
Then I split all those files up into 8 different directories, each directory staying just under 12MB (maximum size Acode can open)
Then I merged each directory into a txt file. So 8 txt files total.
Then I used Acode to put a space before and after the start of pbs.twimg.com URLs. Separating the photo URLs, getting them ready for the next step.
Then I used a website to extract the URLs from the text files.
Then I used another website to keep only lines containing the phrase "pbs.twimg.com/media".
Then I merged all 8 files back into one. Now only containing twitter photo media URLs.
Then I used gallery-dl to download from that list the files that are still on her twitter.
I then generated a list of the downloaded files. I subsequently stripped everything but the filenames from that list (I removed the extensions too).
I stripped the list of URLs in the same way.
Then I compared the two lists with the help of yet another website.
The filenames only on the list of URLs were the ones that weren't on her twitter anymore, and didn't get downloaded with gallery-dl.
I then changed that list back from filenames into URLs. But I additionally added
https://web.archive.org/ in front of those URLs.
I then used the open multiple URLs browser extension to open 20 of the remaining links at a time. And that's how I got to these pictures.
Was it worth the effort? No. But it might have been. I would never have known, hah.
Ps. I also de-duplicated the lists numerous times throughout btw