Adrian Kuschelyagi Malacoda kuschelyagi
kuschelyagi pushed to master at kuschelyagi/otherworld 2020-08-25 17:09:10 +00:00
633ef98fab replace chmod ~ call with a bootstrap script that will chmod all the appropriate directories and also copy from /etc/skel (which won't be done automatically)
42c65b9783 chown ~/.config too, most programs expect it to be writable
Compare 2 commits »
kuschelyagi commented on issue glitch-city-labor.../epilogue#6 2020-08-24 05:57:40 +00:00
Wiki Redirect Script

This is (mostly) implemented, but we are experiencing hurdles with the archive itself. In other words - the redirector generates redirect URLs that are consistent with what the archive generator generates, but the archive generator is not generating the correct URLs in the first place

kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-24 05:56:31 +00:00
2e73ecd59f Begin work on redirector webapp. The logic for redirecting wiki pages -seems- consistent with how the archives are generated but... nginx is normalizing the %2Fs into slashes and therefore not able to access any files with that escape sequence (e.g. Gold%2FSilver). Might need to find another character to escape / with.
kuschelyagi commented on issue glitch-city-labor.../epilogue#1 2020-08-24 05:56:00 +00:00
Tool for exporting PMs to HTML file

This is already implemented

kuschelyagi closed issue glitch-city-labor.../epilogue#1 2020-08-24 05:56:00 +00:00
Tool for exporting PMs to HTML file
kuschelyagi commented on issue glitch-city-labor.../epilogue#5 2020-08-24 05:55:32 +00:00
Static Wiki Website Archive

Progress was made. Main pain points right now:

  • Template transclusion is half-baked. Note that the library we're using (mwparserfromhell) doesn't actually do this so we have to roll our own.
    • Magic words (e.g. PAGENAME, NUMBEROFARTICLES etc) are not yet implemented - they would be implemented like any other template
  • Category parsing/generation is also half-baked, doesn't seem to take into account template transclusion (which it should, since transclusion happens before we look for categories)
  • Images are not yet included. We could make a script to pull images or just use the dump from archive.org for this
  • Page name normalization is funky. Notable in that sometimes a slash (/) indicates a subpage (e.g. GlitchDex/RB:000) and sometimes it's just a slash (e.g. Gold/Silver/Crystal). We have some special logic in both the archive builder and redirector to know the difference.
    • nginx normalizes URLs before passing them into our handlers so e.g. Gold%2FSilver%2FCrystal (which is what we would generate) is interpeted as Gold/Silver/Crystal (i.e. a directory structure), which obviously fails. It's probably possible to configure nginx to get around this but the goal with these archives is to avoid having special server configuration for them, and they should be hostable anywhere. Most likely we need to come up with a new character to represent / (+ is the current candidate)
kuschelyagi commented on issue glitch-city-labor.../epilogue#4 2020-08-24 05:48:02 +00:00
Static HTML Forum Archive

Mostly done. I think the pagination on the forum threads needs to be improved (since we should know how many pages a thread has) and the bbcode has to be tidied up a bit.

kuschelyagi commented on issue glitch-city-labor.../epilogue#3 2020-08-24 05:46:47 +00:00
Forum Redirect Script

This is complicated by the fact that the forum archive is generated in hierarchical order (board-X/thread-Y/page-0.html) and the forum URL only has a thread id and post id. We would either need to generate an index for the redirector or just use the generated forum.sqlite (which we probably could, since we're in the same package as the archive generator and have access to the forum.sqlite

kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-23 11:41:02 +00:00
2aa1a7cf47 improved handling of categories and refactored Linker stuff into a class, also use ./ as default base path so Category: links will work correctly
77b160a35b Add all dex types and make wiki render aware of them, so that dex subpages will be rendered as GlitchDex/RB:000 while phrases like G/S will be rendered as G%2FS.
ea7e1294b1 Escape / with %2F in wiki URLs. For now this includes things which actually should be subdirectories, such as the various dexes.
Compare 3 commits »
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-23 09:49:03 +00:00
df25b09eb7 improvements to template substitution, begin parsing out and dumping category links
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-21 07:52:53 +00:00
43a36ba730 (Attempt to) strip out noinclude tags.
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-21 07:40:46 +00:00
d19ca39838 Add a (very rudimentary) template transcluder. Some work will have to be done before it is ready.
kuschelyagi pushed to master at kuschelyagi/otherworld 2020-08-20 07:49:47 +00:00
b1878aef1b Add --rmi command that removes the generated image.
71fe46e881 Add ability to run multiple "actions" (commit/rm) and even an otherworld command (potentially starting a new container)
d0adb3b0ed Make default image name image_{CONTAINER_NAME}, and use debian:stable as fallback.
Compare 3 commits »
kuschelyagi pushed to master at kuschelyagi/otherworld 2020-08-19 07:49:21 +00:00
77935b49e8 Add --env option that sets environment variables in the launched command (not in the container)
2aec5cfc3b Add ability to commit the otherworld container to an image. The image is named the same as in --build option.
Compare 2 commits »
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-17 06:58:21 +00:00
38cdb811b0 Specify that charset is UTF-8. On the server side we are specifying the charset as UTF-8 so the encoding is already correct on the archives.glitchcity.info site, but the intent is for this to be portable to any web host.
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-17 06:52:04 +00:00
54fa852897 Implement rudimentary wikitext renderer and buff deploy_archives script to be able to deploy the wiki archive, as well as sql/sqlite/xml data dumps.
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-17 02:12:49 +00:00
0b1320a9da Add archives index page, and deploy wiki archives.
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-16 23:53:35 +00:00
6f05f05410 Re-enable archival of wiki by default.
31bdd806ad Allow "forums" as a synonym of "forum"
943563a8db Use new field names.
23f4789599 Fix broken utf-8 encoding and unescape html entities.
4045473e65 Gzip forums.tar to save space and time. Remove verbose output to save time.
Compare 8 commits »
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-11 15:46:19 +00:00
dc0191a04a Rudimentary support for building wiki archives. The content is dumped to html but the wikitext isn't parsed yet.
kuschelyagi pushed to master at glitch-city-labor.../epilogue 2020-08-10 07:00:34 +00:00
3cb08e2d2f Add bbcode library and some bbcode parsing. SMF's bbcode is somewhat different to what this library expects so some of it does not come out correctly.
0116646dd9 Add script to deploy the generated html archive to a server.
Compare 2 commits »