Results 1 to 17 of 17

Thread: Offline version of forum

  1. #1
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts

    Offline version of forum

    Dear admin,

    is there possibility to obtain offline version of forum for viewing?

    Best regards,

    FatBit

  2. The Following 2 Users Say Thank You to FatBit For This Useful Post:

    Bulat Ziganshin (10th June 2014),just a worm (9th June 2014)

  3. #2
    Member just a worm's Avatar
    Join Date
    Aug 2013
    Location
    planet "earth"
    Posts
    96
    Thanks
    29
    Thanked 6 Times in 5 Posts
    I am also interested (if someone cares)

  4. #3
    Member
    Join Date
    Feb 2013
    Location
    San Diego
    Posts
    1,057
    Thanks
    54
    Thanked 71 Times in 55 Posts
    You could write or possibly find a web crawler/scraper and make your own. Based on my experience working on websites, the site owner may have to do essentially that to generate an archive.

  5. #4
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    I know crawler approach. But success depends on forum background type. I will do it for all if admin helps me how (wget parameters tuning etc).

    Best regards,

    FatBit

  6. #5
    Member just a worm's Avatar
    Join Date
    Aug 2013
    Location
    planet "earth"
    Posts
    96
    Thanks
    29
    Thanked 6 Times in 5 Posts
    Using a web crawler usually means that much more is beeing downloaded than what actually is needed. And it easiely takes hours and gigabytes of storage. If I go to a public library then I do not have much time (you pay for the time that you are online) nor do I have much storage (just an usb-stick).

    In some forums it is possible to let the forum send an email, if there is a new message in a specific thread. Maybe it's possible to subscribe to all new threads without haveing to subscribe to every thread separatly. Something mailing-list-a-like.

    Or maybe it is possible to create a rss-feed for new posts. So the offline users would only have to save the output of the rss-feed.

    The forum already has something like this:
    http://encode.ru/activity.php

    It is helpful to find the new content but it only shows a part of the posts.
    Last edited by just a worm; 10th June 2014 at 14:18.

  7. #6
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    Any reaction or recommendation from admin/webmaster?

    Best regards,

    FatBit

  8. #7
    Member
    Join Date
    Feb 2013
    Location
    San Diego
    Posts
    1,057
    Thanks
    54
    Thanked 71 Times in 55 Posts
    I did a quick search and found that there is lots of software available for downloading a website so that you can view it offline. I didn't know about any of this, but maybe you did -- you mentioned constraints on your bandwidth, so maybe these are infeasible.

    http://download.cnet.com/windows/off.../?tag=pub-desc

  9. #8
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    I repeat, I am able to do brutal force download via httrack or wget. But I prefer the agreement with webmaster how to do it "gently".

    FatBit

  10. #9
    Member
    Join Date
    Feb 2013
    Location
    San Diego
    Posts
    1,057
    Thanks
    54
    Thanked 71 Times in 55 Posts
    Quote Originally Posted by FatBit View Post
    I repeat, I am able to do brutal force download via httrack or wget. But I prefer the agreement with webmaster how to do it "gently".

    FatBit
    It looks like this site is running vBulletin 4.2.2. You could do some research to see if there are tools available that work with this site's software and do what you want. If the tools don't exist, then webmaster probably won't have access to anything, either. The only other thing you could do, if you don't find a tool, would be to dig directly into the database with SQL and pull out just what you need. I can't see that approach being appreciably better than httrack/wget.
    Last edited by nburns; 13th June 2014 at 04:10.

  11. #10
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Quote Originally Posted by FatBit View Post
    Any reaction or recommendation from admin/webmaster?

    Best regards,

    FatBit
    Let's wait for webmaster's response!

  12. #11
      webmaster's Avatar
    Join Date
    Jun 2010
    Location
    Saint-Petersburg, Russia
    Posts
    70
    Thanks
    12
    Thanked 53 Times in 24 Posts
    How many people will use it? 3 or more?

    There are two ways:

    1. Develop an application. It will automatically receive updates. But I program only under Windows.
    2. Development of the server-side script, which will give a clean text messages. Everyone can write your own application.

    Opinions?

  13. The Following User Says Thank You to webmaster For This Useful Post:

    encode (17th June 2014)

  14. #12
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    Third way: to share "database files" for offline work of appropriate forum version?

    Best regards,

    FatBit

  15. #13
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,954
    Thanks
    359
    Thanked 332 Times in 131 Posts
    Databases may contain inappropriate information - such as private messages and user info...

  16. #14
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    I meant only forum files, restricted backup etc.

  17. #15
      webmaster's Avatar
    Join Date
    Jun 2010
    Location
    Saint-Petersburg, Russia
    Posts
    70
    Thanks
    12
    Thanked 53 Times in 24 Posts
    1. Database files contain a lot of unnecessary information, which is necessary for the whole forum.
    2. If all messages are stored in a single file, the client will download the whole file every time to get one or two new messages.

    I propose the following algorithm:

    First server-side script.
    Request: GET 1script.name. Answer: last_thread_id;last_post_id
    If the client has a smaller ID than the answer, he asks the missing messages or threads through the second script.

    Second server-side script.
    Request: GET 2script.name?t=[threadid]. Answer (XML): thread_time; thread_autor; thread_title
    or
    Request: GET 2script.name?p=[postid]. Answer (XML): post_time; post_title; post_author; post_body

    So, client requests the first script. If there are new messages or threads, then through the second script asks them. Very small request, very small response. Works very quickly. After the first synchronization, the client has all the posts and topics.

  18. #16
    Member FatBit's Avatar
    Join Date
    Jan 2012
    Location
    Prague, CZ
    Posts
    189
    Thanks
    0
    Thanked 36 Times in 27 Posts
    Dear admin,

    I thing that would be interesting to prepare datafile for something like AtomNet (http://change7.com/atomnet/)

    • AtomNet can browse the web and supports the principal HTML 3 tags, but it doesn't support neither JavaScript nor Activex controls.
    • Zip support: can browse HTML pages and images and plays WAV files, compressed into zip files.
    • Full text search into zip files.
    • No installation is required. Only one file is demanded to run the program.
    • Support frames, jpeg, bmp and animated gif images.
    • It is useful to manage web resources locally or to access to digital books collections, either in HTML or ASCII format..
    • Their main use is off-line and Intranet browsing.


    Your proposal looks fine but I am not familiar with this topic to be qualified reviewer.

    Best regards,

    FatBit

  19. #17
    Member just a worm's Avatar
    Join Date
    Aug 2013
    Location
    planet "earth"
    Posts
    96
    Thanks
    29
    Thanked 6 Times in 5 Posts
    can't the existing script

    http://encode.ru/activity.php

    just be expanded so it shows the whole message with the addition that it shows more messages than it currently does? If the script would be expanded that way then we could just run it by surfing to something like

    http://encode.ru/activity_expanded.php

    save the webpage to an usb stick or the hard disk and then go offline again.

Similar Threads

  1. New forum
    By Bulat Ziganshin in forum The Off-Topic Lounge
    Replies: 71
    Last Post: 14th August 2011, 19:01
  2. New or old forum?
    By encode in forum The Off-Topic Lounge
    Replies: 21
    Last Post: 10th May 2008, 00:54
  3. NEW FORUM!
    By encode in forum Forum Archive
    Replies: 4
    Last Post: 5th May 2008, 10:15
  4. Forum mirror
    By Shelwien in forum Forum Archive
    Replies: 23
    Last Post: 25th February 2008, 18:02
  5. Forum Abuse
    By LovePimple in forum Forum Archive
    Replies: 10
    Last Post: 20th February 2007, 21:50

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •