Freelance Data Scraping Engineer (Python)

Freelance Data Scraping Engineer (Python)

Company: Mindrift Location: Remote (Romania) Contract: Freelance Salary: Up to $40 per hour equivalent

Mindrift is seeking skilled Python Data Scraping Engineers to join the Tendem project. In this role, you will collaborate with AI agents, providing critical thinking, domain expertise, and quality control to deliver accurate and actionable data. This part-time, remote opportunity is perfect for technical professionals with hands-on experience in web scraping, data extraction, and processing.

About Mindrift

The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by leveraging real-world expertise from around the globe.

About the Role

As a Python Data Scraping Engineer on the Tendem project, you will be responsible for data scraping tasks requiring technical precision for web extraction and processing. You will utilize tools such as Apify and OpenRouter, alongside your own resourceful approaches, to ensure efficient and accurate data collection.

Key Responsibilities

• Manage end-to-end data extraction workflows from complex websites, ensuring comprehensive coverage, accuracy, and reliable delivery of structured datasets.
• Utilize internal tools (Apify, OpenRouter) and custom workflows to accelerate data collection, validation, and task execution while meeting project requirements.
• Ensure reliable extraction from dynamic and interactive web sources, adapting methods to handle JavaScript-rendered content and evolving site structures.
• Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification before delivery.
• Scale scraping operations for large datasets using efficient batching or parallelization, monitor for failures, and maintain stability against minor site structure changes.

Requirements

• At least 3 years of relevant experience in data engineering, web scraping, automation, or software development.
• Strong experience in Python web scraping (e.g., BeautifulSoup, Selenium), including handling dynamic content (JavaScript, AJAX, infinite scroll) and APIs via proxies.
• Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML).
• Solid background in data cleaning, normalization, and validation, with experience delivering structured datasets (CSV, JSON, Google Sheets).
• Hands-on experience with Large Language Models (LLMs) and AI frameworks to enhance automation and problem-solving is a plus.
• Strong attention to detail and a commitment to data accuracy.
• Self-directed work ethic with the ability to troubleshoot independently.
• English proficiency: Upper-intermediate (B2) or above.
• A Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus.
• A link to your GitHub profile is a plus.

What We Offer

• Fully Remote Work: Work from anywhere with a laptop and stable internet connection, on your own schedule.
• Unique Experience: Gain hands-on experience in a distinctive hybrid environment where human expertise and AI agents collaborate, developing a valuable skill set in a rapidly growing field.
• Performance-Based Rewards: Participate in bonus programs that recognize and reward high-quality work and consistent delivery.