https://coptr.digipres.org/api.php?action=feedcontributions&feedformat=atom&user=Eve+wrightnrs 2026-05-25T09:10:04Z User contributions MediaWiki 1.35.14 https://coptr.digipres.org/index.php?title=Brozzler&diff=5533 2021-12-09T16:16:27Z

<p>Eve wrightnrs: </p> <hr /> <div>{{Infobox tool<br /> |image=Brozzler-icon (1).png<br /> |purpose=From GitHub (https://github.com/internetarchive/brozzler):<br /> Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetch pages and embedded URLs and to extract links. <br /> <br /> Brozzler is designed to work in conjunction with warcprox for web archiving.<br /> |homepage=https://github.com/internetarchive/brozzler<br /> |function=Web Capture<br /> |content=Web<br /> }}<br /> {{Infobox tool details}}<br /> == Description ==<br /> Brozzler is a distributed browser based web crawler. It was built by the Internet Archive.<br /> <br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000343186-What-is-Brozzler-<br /> <br /> Brozzler is our newest crawling technology, built at the Internet Archive.<br /> <br /> Brozzler differs from Archive-It's &quot;Standard&quot; crawling technology (Heritrix and Umbra) in its reliance on an actual web browser to interact with web content before that content is indexed and archived into WARC files. Instead of following hyperlinks and downloading files, Brozzler records interactions between servers and web browsers as they occur, more closely resembling how a human user would experience the web. It also uses youtube-dl to enhance media capture capabilities. (as of January 2020 both Brozzler and Standard crawls use youtube-dl).<br /> <br /> For more information on how this process works, and the related open-source tools on which it relies, you can review Brozzler’s code and technical documentation in its GitHub repository.<br /> <br /> Link to GitHub rep:<br /> https://github.com/internetarchive/brozzler<br /> <br /> == User Experiences ==<br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000351986-How-and-when-to-use-Brozzler<br /> <br /> When to Use Brozzler:<br /> <br /> &quot;If dynamic elements on a page were not captured in a Standard crawl or you're seeing a number of error pages when viewing results in Wayback, running a test crawl using Brozzler is a good next step&quot;.</div>

Eve wrightnrs https://coptr.digipres.org/index.php?title=File:Brozzler-icon_(1).png&diff=5532 2021-12-09T16:15:36Z

<p>Eve wrightnrs: </p> <hr /> <div></div>

Eve wrightnrs https://coptr.digipres.org/index.php?title=Brozzler&diff=5531 2021-12-09T16:12:52Z

<p>Eve wrightnrs: /* User Experiences */</p> <hr /> <div>{{Infobox tool<br /> |purpose=From GitHub (https://github.com/internetarchive/brozzler):<br /> Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetch pages and embedded URLs and to extract links. <br /> <br /> Brozzler is designed to work in conjunction with warcprox for web archiving.<br /> |homepage=https://github.com/internetarchive/brozzler<br /> |function=Web Capture<br /> |content=Web<br /> }}<br /> {{Infobox tool details}}<br /> == Description ==<br /> Brozzler is a distributed browser based web crawler. It was built by the Internet Archive.<br /> <br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000343186-What-is-Brozzler-<br /> <br /> Brozzler is our newest crawling technology, built at the Internet Archive.<br /> <br /> Brozzler differs from Archive-It's &quot;Standard&quot; crawling technology (Heritrix and Umbra) in its reliance on an actual web browser to interact with web content before that content is indexed and archived into WARC files. Instead of following hyperlinks and downloading files, Brozzler records interactions between servers and web browsers as they occur, more closely resembling how a human user would experience the web. It also uses youtube-dl to enhance media capture capabilities. (as of January 2020 both Brozzler and Standard crawls use youtube-dl).<br /> <br /> For more information on how this process works, and the related open-source tools on which it relies, you can review Brozzler’s code and technical documentation in its GitHub repository.<br /> <br /> Link to GitHub rep:<br /> https://github.com/internetarchive/brozzler<br /> <br /> == User Experiences ==<br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000351986-How-and-when-to-use-Brozzler<br /> <br /> When to Use Brozzler:<br /> <br /> &quot;If dynamic elements on a page were not captured in a Standard crawl or you're seeing a number of error pages when viewing results in Wayback, running a test crawl using Brozzler is a good next step&quot;.</div>

Eve wrightnrs https://coptr.digipres.org/index.php?title=Brozzler&diff=5530 2021-12-09T16:12:35Z

<p>Eve wrightnrs: /* Description */</p> <hr /> <div>{{Infobox tool<br /> |purpose=From GitHub (https://github.com/internetarchive/brozzler):<br /> Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetch pages and embedded URLs and to extract links. <br /> <br /> Brozzler is designed to work in conjunction with warcprox for web archiving.<br /> |homepage=https://github.com/internetarchive/brozzler<br /> |function=Web Capture<br /> |content=Web<br /> }}<br /> {{Infobox tool details}}<br /> == Description ==<br /> Brozzler is a distributed browser based web crawler. It was built by the Internet Archive.<br /> <br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000343186-What-is-Brozzler-<br /> <br /> Brozzler is our newest crawling technology, built at the Internet Archive.<br /> <br /> Brozzler differs from Archive-It's &quot;Standard&quot; crawling technology (Heritrix and Umbra) in its reliance on an actual web browser to interact with web content before that content is indexed and archived into WARC files. Instead of following hyperlinks and downloading files, Brozzler records interactions between servers and web browsers as they occur, more closely resembling how a human user would experience the web. It also uses youtube-dl to enhance media capture capabilities. (as of January 2020 both Brozzler and Standard crawls use youtube-dl).<br /> <br /> For more information on how this process works, and the related open-source tools on which it relies, you can review Brozzler’s code and technical documentation in its GitHub repository.<br /> <br /> Link to GitHub rep:<br /> https://github.com/internetarchive/brozzler<br /> <br /> == User Experiences ==<br /> &lt;!-- From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000351986-How-and-when-to-use-Brozzler<br /> <br /> When to Use Brozzler:<br /> <br /> &quot;If dynamic elements on a page were not captured in a Standard crawl or you're seeing a number of error pages when viewing results in Wayback, running a test crawl using Brozzler is a good next step&quot;. --&gt;</div>

Eve wrightnrs https://coptr.digipres.org/index.php?title=Brozzler&diff=5528 2021-12-09T16:10:27Z

<p>Eve wrightnrs: </p> <hr /> <div>{{Infobox tool<br /> |purpose=From GitHub (https://github.com/internetarchive/brozzler):<br /> Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetch pages and embedded URLs and to extract links. <br /> <br /> Brozzler is designed to work in conjunction with warcprox for web archiving.<br /> |homepage=https://github.com/internetarchive/brozzler<br /> |function=Web Capture<br /> |content=Web<br /> }}<br /> {{Infobox tool details}}<br /> == Description ==<br /> &lt;!-- Brozzler is a distributed browser based web crawler. It was built by the Internet Archive.<br /> <br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000343186-What-is-Brozzler-<br /> <br /> Brozzler is our newest crawling technology, built at the Internet Archive.<br /> <br /> Brozzler differs from Archive-It's &quot;Standard&quot; crawling technology (Heritrix and Umbra) in its reliance on an actual web browser to interact with web content before that content is indexed and archived into WARC files. Instead of following hyperlinks and downloading files, Brozzler records interactions between servers and web browsers as they occur, more closely resembling how a human user would experience the web. It also uses youtube-dl to enhance media capture capabilities. (as of January 2020 both Brozzler and Standard crawls use youtube-dl).<br /> <br /> For more information on how this process works, and the related open-source tools on which it relies, you can review Brozzler’s code and technical documentation in its GitHub repository.<br /> <br /> Link to GitHub rep:<br /> https://github.com/internetarchive/brozzler --&gt;<br /> <br /> == User Experiences ==<br /> &lt;!-- From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000351986-How-and-when-to-use-Brozzler<br /> <br /> When to Use Brozzler:<br /> <br /> &quot;If dynamic elements on a page were not captured in a Standard crawl or you're seeing a number of error pages when viewing results in Wayback, running a test crawl using Brozzler is a good next step&quot;. --&gt;</div>

Eve wrightnrs https://coptr.digipres.org/index.php?title=Brozzler&diff=5525 2021-12-09T16:03:16Z

<p>Eve wrightnrs: Created page with &quot;{{Infobox tool |purpose=From GitHub (https://github.com/internetarchive/brozzler): Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetc...&quot;</p> <hr /> <div>{{Infobox tool<br /> |purpose=From GitHub (https://github.com/internetarchive/brozzler):<br /> Brozzler is a distributed web crawler that uses a real browser (Chrome or Chromium) to fetch pages and embedded URLs and to extract links. <br /> <br /> Brozzler is designed to work in conjunction with warcprox for web archiving.<br /> |homepage=https://github.com/internetarchive/brozzler<br /> |function=Web Capture<br /> |content=Web<br /> }}<br /> {{Infobox tool details}}<br /> == Description ==<br /> &lt;!-- Brozzler is a distributed browser based web crawler. It was built by the Internet Archive.<br /> <br /> From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000343186-What-is-Brozzler-<br /> <br /> Brozzler is our newest crawling technology, built at the Internet Archive.<br /> <br /> Brozzler differs from Archive-It's &quot;Standard&quot; crawling technology (Heritrix and Umbra) in its reliance on an actual web browser to interact with web content before that content is indexed and archived into WARC files. Instead of following hyperlinks and downloading files, Brozzler records interactions between servers and web browsers as they occur, more closely resembling how a human user would experience the web. It also uses youtube-dl to enhance media capture capabilities. (as of January 2020 both Brozzler and Standard crawls use youtube-dl).<br /> <br /> For more information on how this process works, and the related open-source tools on which it relies, you can review Brozzler’s code and technical documentation in its GitHub repository.<br /> <br /> Link to GitHub rep:<br /> https://github.com/internetarchive/brozzler<br /> --&gt;<br /> <br /> == User Experiences ==<br /> &lt;!-- From Internet Archive: https://support.archive-it.org/hc/en-us/articles/360000351986-How-and-when-to-use-Brozzler<br /> <br /> When to Use Brozzler:<br /> <br /> &quot;If dynamic elements on a page were not captured in a Standard crawl or you're seeing a number of error pages when viewing results in Wayback, running a test crawl using Brozzler is a good next step&quot;. --&gt;</div>

Eve wrightnrs