Web Scraping Engineer

Job Summary

We are seeking a Web Scraping Engineer with over 3 years of experience to handle web data extraction tasks efficiently. The engineer will play a crucial role in developing and maintaining web scraping solutions that contribute to data-driven decision-making within the organization.

Responsibilities

• Develop and implement web scraping solutions to extract data from websites.
• Maintain and optimize existing scraping solutions for performance and reliability.
• Analyze and structure data for various applications and databases.
• Collaborate with data scientists and analysts to understand data requirements.
• Ensure compliance with legal and ethical standards regarding data access and usage.
• Troubleshoot and resolve issues related to web scraping and data extraction processes.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proficiency in programming languages such as Python or JavaScript for web scraping.
• Familiarity with web scraping frameworks and libraries (e.g., BeautifulSoup, Scrapy, Selenium).
• Experience with databases and data storage solutions (e.g., SQL, NoSQL).
• Strong understanding of HTTP, HTML, and web protocols.
• Analytical and problem-solving skills.
• Ability to adapt to changing technologies and tools.

Preferred Skills

• Experience with cloud platforms (e.g., AWS, Google Cloud).
• Knowledge of data processing tools and technologies (e.g., Pandas, NumPy).
• Familiarity with machine learning concepts for advanced data processing.

Experience

• Minimum of 3 years of relevant experience in web scraping or data extraction roles.

Environment

• This position is available for applicants located in Bangalore or Ahmedabad. The work environment may vary from office-based to hybrid setups depending on company policies.