---
title: Greek web scraper
slug: greek-web-scraper
author: Charis Nikolaidis
year: 2024
type: Published package
tech: [Python, Scrapy, spaCy, JSONL]
url: https://charisnikolaidis.com/projects/#greek-web-scraper
---

# Greek web scraper

A Scrapy crawler for Greek-language web content, with NLP filtering to drop the
junk and clean JSONL on the way out. Built for a data collection job, then
packaged and pushed to PyPI in case anybody else needs a pile of Greek text. You
can just pip install it.

**Type:** Published package · **Year:** 2024
**Stack:** Python, Scrapy, spaCy, JSONL

## What's inside

- Concurrent crawling on Scrapy.
- NLP filtering to keep Greek content and drop boilerplate.
- Clean JSONL output for downstream training.
- Retry and encoding handling for messy pages.
- Published on PyPI with docs.

## Links

- GitHub: <https://github.com/Charisn/Greek-web-scraper>
- PyPI: <https://pypi.org/project/greek-web-crawler/>

## Related

- Profile: <https://charisnikolaidis.com/llms.txt>
- All projects: <https://charisnikolaidis.com/projects/>