Zoekresultaten

  • Update

    Start Werkgroep: Downloads van Twitteraccounts verwerken/archiveren Krijgt jouw organisatie wel eens gedownloade Twitter/X-accounts overgedragen? En wil je graag meewerken aan een methode deze vervolgens goed te verwerken en op te slaan? Schrijf je nu in voor de werkgroep! Voorzitterschap: KB, Sophie Ham en Daniel Steinmeier start werkgroep: 15 februari 2024 van 15.00 tot 16.30 LET OP: aangepaste datum Drie langere bijeenkomsten met de werkgroep per thema: analyseren social media content,...

  • Update

    Draag bij aan de speciale webcollectie "War in Ukraine" Een internationale samenwerkingsverband van webarchivarissen - gecoördineerd door Vladimir Tybin van de Franse nationale bibliotheek - bouwt samen aan een collectie websites over de oorlog in Oekraïne. Iedereen kan nog tot 12 maart suggesties doen voor op te nemen websites via dit formulier. Hier kun je meer lezen over de collectie.

  • Update

    De 20e editie van het grootste internationale congres over webarchivering - de Web Archiving Conference van het International Internet Preservation Consortium (IIPC) - vindt dit jaar plaats in Nederland. De KB organiseert deze jubileumeditie samen met Beeld & Geluid in Hilversum. Voor wie is de conferentie bedoeld? De webarchiveringsconferentie is er voor iedereen die zich professioneel met webarchivering bezighoudt: archivarissen, preserveringsexperts, softwareontwikkelaars en onderzoekers...

  • Update

    Het is zover, Twitter kondigde gisteren aan dat zijn API betalend zal worden vanaf 9 februari: https://twitter.com/TwitterDev/status/1621026986784337922 Er is nog geen verdere informatie over de gevolgen voor gebruikers. Zal de Twitter API Academic Track beschikbaar blijven en wat zijn de gevolgen voor Twarc-gebruikers? Wanneer de wijzigingen bekend zijn, worden ze opgenomen in de handleidingen over tools om Twitter te archiveren op CEST bv. https://www.projectcest.be/wiki/Publicatie:Twitte...

  • Update

    Web Archiving Conference 2023 in Nederland: call for proposals De KB en het Instituut voor Beeld &Geluid organiseren samen de internationale webarchiveringsconferentie van het IIPC (International Internet Preservation Coalition) op 11 en 12 mei 2023 te Hilversum. Het is de 20ste editie van het congres, dat jaarlijks ongeveer 200 collega’s van over de hele wereld aantrekt. De laatste keer dat de WAC (Web Archiving Conference) in Nederland plaatsvond was in 2011. Veerkracht en Vernieuwing Het t...

  • Update

    Update over tools voor Sociale media-archivering In 2020 onderzocht Zefi Kavvadia van het IISG - in het kader van een NDE-project - tools om sociale media mee te archiveren. Zij reviewde maar liefst negen tools, waaronder Webrecorder, Social Feed Manager en TAGS. Sommige tools kunnen heel eenvoudig worden gebruikt, andere vragen behoorlijk wat technische expertise. Ook ontbreekt documentatie nog al eens. Om de resultaten van dit onderzoek nog beter toegankelijk te maken en om het in de toekom...

  • Commercial Social Media Archiving Tools: Summary of First Survey by NDE/IISG

    Social media archiving is one of the latest hot topics in digital preservation and information and records management. It is now becoming widely recognized that the contemporary record, whether it is meant for evidence, research, memory or any combination of the above, can and will very often contain material originating from various social media platforms. Background of the project In the Netherlands too there has been recent mounting interest in developing and establishing social media arch...

  • Examples of social media

    Social networking sites e.g. Facebook, LinkedIn, WhatsApp, Telegram, Viber, Signal, I-message, Facebook Messenger, WeChat; dating apps such as Tinder, Bumble, Inner Circle, Grindr– sites that connect friends, groups based on interests or professions. Blogs e.g. Medium, Wordpress, Blogger, and Tumblr; Twitter can be considered as micro-blogging Image and video sharing platforms e.g YouTube, Vimeo, Tumblr, Instagram, Snapchat, Imgur, TikTok, and Pinterest Discussion sites e.g. Reddit, Quora ...

  • Structured data formats (JSON, CSV, XLSX)

    The turn to more data-intensive access methods to web and social media archives, as indicated by the use of big data and digital humanities methods to analyze social media content calls for capturing social media in formats appropriate for these activities. Usually in formats like JSON, CSV, and XLSX, collections made up of structured data are more amenable to computational methods such as network analysis, topic modelling, and many other visualization and analysis methods. Indeed, critics of...

  • WARC

    The WARC format is widely accepted enough to be considered one of the default formats for storing captured content from the web. It followed its predecessor, the ARC, as the main file format in use by the Internet Archive, and is maintained by the International Internet Preservation Consortium (IIPC). The rationale behind the WARC format is that one file format for web archiving should preferably be able to hold not only the archived resources themselves, but also metadata about the resources...

  • File formats for social media collections

    The two general approaches to social media archiving presented here ("look and feel" and "structured data") also have implications for file format selection, which by extension has implications for preservation and collection quality. The choices made when capturing and preserving, part of which is selecting appropriate formats according to one's purpose, will affect the possible uses the collection can be put into, and by extension, the types of users the collection will be useful for.

  • References

    Samenvatting: This is a list of sources referenced in this wiki. Care has been taken to include every source, however additions and corrections for things that might have been accidentally overlooked are of course welcome!

  • TAGS

    It is safe to say that most of the tools that output structured data are not the easiest or most intuitive to use. One notable exception then is TAGS (Twitter Archiving Google Sheet). TAGS is in essence an app built on Google Sheets, that uses the Twitter API to fetch structured data based on queries the user inputs in the spreadsheet. TAGS makes use of an already authenticated Twitter API app for its operation, but you are able to use your own Twitter API app if you prefer. The strongest poi...

  • Crocoite

    Note: According to its GitHub page, this tool is not in active development anymore at the time of this writing (January 2022). However, it is still available for download and it still functions as expected. In a way, crocoite is a good example of a tool arising from the open-source community that could prove problematic to use in a professional setting because of lack of ongoing support. As browser-based crawling seems to become central in the practice of archiving the dynamic web including ...

  • Munin-Indexer (Munin)

    Munin (Munin-Indexer) uses Docker to wrap different scraping and archiving tools together and offer a scraping solution for Facebook, Instagram, and VKontakte. It indexes and scrapes posts, then crawls and captures them, and finally uses pywb to display them. Suitable for public social media content The important thing to note about Munin is that it is only able to archive public posts, i.e., only posts that do not sit behind a log-in. Consequently, this means that it is useful for archiving...

  • Brozzler

    For those looking for large-scale harvesting solutions, Brozzler, like Browsertrix, is an interesting choice. Brozzler was developed and is still being maintained by the Internet Archive, and it is already used by organizations such as the Portuguese Web Archive. It is a browser-based crawler which uses Chrome or Chromium to access web content and harvest it in a WARC file. Brozzler is one of the newer-generation capturing tools which leverages browser technologies to interact with pages and...