Data Engineer Web Scraping Data Ingestion
AlertMediaMexico City, Mexico
Full Time
Posted January 2, 2026
Apply Now
Application opens on company website
Job Description
A Data Engineer at AlertMedia is responsible for designing, building, and maintaining large-scale web scraping and data ingestion pipelines sourcing data from open-source platforms and social media, to support real-time threat detection and risk intelligence. The role involves optimizing data pipelines for reliability, performance, and scalability, collaborating with cross-functional teams, and ensuring data quality for downstream systems.
Key Responsibilities
- Design, build, and maintain scalable web scraping and data ingestion pipelines from open-source datasets and social media platforms.
- Optimize existing data pipelines for performance, reliability, and cost efficiency.
- Handle challenges such as anti-bot protections, rate limiting, schema changes, and data quality issues.
- Build and maintain ingestion pipelines that feed downstream systems like Elasticsearch and other data stores.
- Collaborate with cross-functional teams to ensure data meets customer and business needs.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related technical field (preferred).
- 4 to 6 years of demonstrated experience in data engineering or backend engineering roles.
- Significant, hands-on experience with web scraping in production, including large-scale or high-reliability systems.
- Strong proficiency in Python for data ingestion, scraping, and pipeline development.
- Experience building and operating ETL pipelines, including data validation and transformation.
- Experience with stream processing and/or event-driven architectures such as Kafka, Kinesis, SQS, etc. (strong plus).
- Experience working with Elasticsearch or similar search data indexing systems.
- Solid understanding of databases and data storage systems such as Postgres, Redis, or similar.
- Experience with AWS or other cloud platforms.
- Ability and desire to work in a fast-paced, technically challenging environment.
- Excellent written and verbal communication skills, with the ability to collaborate cross-functionally.
- English proficiency (written and oral) is required.
Benefits & Perks
Competitive Base Salary
Annual Company Bonus
100% Employer-Paid Medical, Dental, and Vision Coverage
Parental Leave Program
Christmas Bonus
Aguinaldo
Generous Vacation and Holiday Policy
Monthly Work-from-Home Stipend
All Necessary Equipment Provided (Laptop, monitor, accessories)
Recognition Rewards
Language Immersion Program
Continuous Learning and Growth Opportunities (mentorship, tech talks, career development sessions)
Award-Winning Culture
Ready to Apply?
Join AlertMedia and make an impact in renewable energy
Stay Updated on Sustainability Jobs
Get the latest renewable energy jobs and career tips delivered to your inbox.
Job Alerts
Get notified about new sustainability jobs
More jobs at AlertMedia
Security Engineer
AlertMedia
NEW
Austin
Full Time
2d
Talent Sourcer
AlertMedia
NEW
Mexico City
Part Time
2d
Enterprise Customer Success Manager
AlertMedia
Austin
Full Time
Feb 27
More jobs in Mexico City, Mexico
Senior Sales Trader - LATAM Market
STX Group
Mexico City
Full Time
Jan 6
Bilingual Collections Specialist
GoodLeap
Mexico City
Part Time
Jan 8
$0k-0k/hr
Call Center Trainer
GoodLeap
Mexico City
Full Time
Jan 8
$350k-450k