Backing up the body of knowledge that is EGF
Moderator: Board Staff
- Monk Ed
- Sunshine Administrator
- Age: 38
- Posts: 8601
- Joined: Jul 12, 2008
- Location: Chicagoland area
- Gender: Male
Backing up the body of knowledge that is EGF
I just had a thought recently, how much of a risk is there that all these accumulated years of discussions and analysis, etc, could get lost if some mistake at the hosting company or some hacking fiasco were to happen? I thought of this while reading through the Evangelion 2.XX Storyboards vs Final topic and thinking "Wow, this is so cool... This needs to be preserved forever". Would it be possible for random users like us to download backups of at least the text of the forums? (Huge as even that would surely be.)
System Administrator
"NGE is like a perfectly improvised jazz piece. It builds on a standard and then plays off it from there, and its developments may occasionally recall what it's done before as a way of keeping the whole concatenated." -- Eva Yojimbo
"To me watching anime is not just for killing time or entertainment, it is a life style, and a healthy one too." -- symbv
"That sounds like the kind of science that makes absolutely 0 sense when you stop and think about it... I LOVE IT." -- Rosenakahara
"NGE is like a perfectly improvised jazz piece. It builds on a standard and then plays off it from there, and its developments may occasionally recall what it's done before as a way of keeping the whole concatenated." -- Eva Yojimbo
"To me watching anime is not just for killing time or entertainment, it is a life style, and a healthy one too." -- symbv
"That sounds like the kind of science that makes absolutely 0 sense when you stop and think about it... I LOVE IT." -- Rosenakahara
- Mr. Tines
- Administrator
- Age: 66
- Posts: 21375
- Joined: Nov 23, 2004
- Location: This sceptered isle.
- Gender: Male
- Contact:
Well, there's always the approach we took to making backups of the AnimeNation Evangelion forum in its heyday -- write a simple web-crawler that just visits every thread and slurps down the contents.
Reminder: Play nicely <<>> My vanity publishing:- NGE|blog|Photos|retro-blog|Fanfics &c.|MAL|𝕏|🐸|🦣
Avatar: art deco Asuka
Avatar: art deco Asuka
- riffraff11235
- Seed of Life
- Age: 31
- Posts: 3975
- Joined: Jul 19, 2012
- Location: Long Island, New York, USA
- Gender: Male
I wonder how much data all ~600k posts would take up in a text file.... This needs to be safeguarded somehow. I mean, the forum is an almost ten-year-long collective effort; it would be a shame to lose it all because there's no backup.
だから みんな 死んでしまえば いいのに... では, あなたは何故, ココにいるの? ...ココにいても, いいの?
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
- MoroNoKimi
- Sachiel
- Age: 33
- Posts: 214
- Joined: Dec 18, 2010
- Location: Sea of LCL
- riffraff11235
- Seed of Life
- Age: 31
- Posts: 3975
- Joined: Jul 19, 2012
- Location: Long Island, New York, USA
- Gender: Male
Text takes up a very small amount of space. The images on this forum probably make up a larger portion of the data than the text does.
Ornette could probably carry around a copy of the entire forum on one of these.
だから みんな 死んでしまえば いいのに... では, あなたは何故, ココにいるの? ...ココにいても, いいの?
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
- Mr. Tines
- Administrator
- Age: 66
- Posts: 21375
- Joined: Nov 23, 2004
- Location: This sceptered isle.
- Gender: Male
- Contact:
We do have a daily database backup run at midnight (server time)
and the backup size is
for the whole site -- which is tiny in this day and age.
cron job wrote:This is a message from the evageeks.org database backup script
Began backup process on: Sat May 4 00:00:02 PDT 2013
Ended backup process on: Sat May 4 00:11:35 PDT 2013
=========================
The database backup has hopefully been successful
and the backup size is
04-May-2013 00:11 269M
for the whole site -- which is tiny in this day and age.
Reminder: Play nicely <<>> My vanity publishing:- NGE|blog|Photos|retro-blog|Fanfics &c.|MAL|𝕏|🐸|🦣
Avatar: art deco Asuka
Avatar: art deco Asuka
- riffraff11235
- Seed of Life
- Age: 31
- Posts: 3975
- Joined: Jul 19, 2012
- Location: Long Island, New York, USA
- Gender: Male
Seriously? Ah, I take it the images are saved as links, right? Even still, that means that each post is saved in an average of about 400 bytes! Does it take 11 minutes because the data is compressed?
だから みんな 死んでしまえば いいのに... では, あなたは何故, ココにいるの? ...ココにいても, いいの?
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
"Cogito ergo sum." - Rene Descartes
"Men do not quit playing because they grow old; they grow old because they quit playing." - Oliver Wendell Holmes
Avatar: Asuka is superior. That is all.
PSN - riffraff-11235 Feel free to add me. PM me on EGF if you do.
Steam - rifffraff11235
League of Legends - riffraff11235
Osu! - riffraff11235
- Mr. Tines
- Administrator
- Age: 66
- Posts: 21375
- Joined: Nov 23, 2004
- Location: This sceptered isle.
- Gender: Male
- Contact:
Yes, (most) images aren't in the database, only their URLs; and this is the resulting bzipped tarball size.
Reminder: Play nicely <<>> My vanity publishing:- NGE|blog|Photos|retro-blog|Fanfics &c.|MAL|𝕏|🐸|🦣
Avatar: art deco Asuka
Avatar: art deco Asuka
Return to “EvaGeeks News and Feedback”
Who is online
Users browsing this forum: No registered users and 2 guests