Experience
- 1 to 3 years
- The applicants should have experience in the following business area(s): BPO/ Data Entry Firm, IT Enabled Service, Software Company
- Freshers are also encouraged to apply.
Education
- Bachelor of Science (BSc) in Computer Engineering, Computer Science
Requirements
- 1 to 3 years
- The applicants should have experience in the following business area(s): BPO/ Data Entry Firm, IT Enabled Service, Software Company
- Freshers are also encouraged to apply.
Skills Required
Additional Requirements
- Age At least 24 years
Responsibilities & Context
Key Responsibilities
Develop and maintain web scraping crawlers using Java, Groovy and Selenium for static and dynamic websites.
Handle common scraping challenges: pagination, sessions and cookies, logins, JavaScript-rendered pages, rate limits and anti-bot measures.
Optimize existing scraping scripts for performance and adaptability and fix them quickly when target websites change.
Extract, parse and transform data from HTML, JSON, XML, CSV and PDF sources for seamless integration with client systems.
Apply testing strategies to ensure data quality and integrity.
Use Docker to run, deploy and manage scraper environments on VDI or client provided platform.
Develop Groovy scripts and tools for automation and integration tasks.
Use AI-driven coding tools, mainly Claude Code, to write, refactor, debug and test scraper code, and review all AI-generated code for correctness and quality.
Debug code, troubleshoot production issues and find root causes when scrapers break or data quality drops.
Work with clients and internal teams to define data requirements and ensure successful data flow.
Keep code structure and workflows clear and documented for maintainability and knowledge sharing.
Manage tasks in JIRA within an Agile process, use Git for version control and take part in code reviews.
Explore and adopt emerging web scraping technologies.
Required Qualifications
Bachelor’s degree in Computer Science & Engineering or a related field (preferred).
1–3 years of experience as a Software Engineer (Java) in web scraping or a related field.
Strong expertise in Java and Groovy, with proven ability to apply OOP concepts to real-world problems.
Solid core Java knowledge, including collections, exception handling and multithreading.
Extensive experience crafting and applying advanced regular expressions (RegEx).
Proficient in Selenium, HtmlUnit and other web automation tools.
Familiarity with HTTP client libraries (such as Apache HttpClient), Jsoup, Apache PDFBox and CSV parsers.
Solid understanding of web scraping techniques, HTTP, HTML/CSS parsing, the DOM, XPath and data structures.
Hands-on experience using AI-driven coding tools for software development, especially Claude Code.
Proficiency in Docker, JIRA, Git and GitHub.
Comfortable with IntelliJ IDEA and Visual Studio Code, and in both Ubuntu/Linux and Windows environments.
Strong debugging, problem-solving and analytical skills to handle unexpected data scenarios.
Nice to Haves
Experience handling anti-bot measures such as proxy rotation, CAPTCHAs and browser fingerprinting.
Experience with Playwright or other headless browser tools.
Experience writing effective prompts and project instructions for Claude Code to speed up development.
Basic SQL with PostgreSQL, MySQL or a similar database.
Knowledge of the client's industry and its data challenges.
Soft Skills
Strong written and verbal English communication for working with clients and cross-functional teams.
Detail-oriented approach to ensure data accuracy and code quality.
Able to work independently, collaborate in a team and manage multiple tasks at once.
Quick learner with a proactive mindset.
Solution-oriented, and able to work extended hours during critical project phases when needed.
Job Other Benifits
- Weekly 2 holidays,Insurance
- Lunch Facilities: Partially Subsidize
- Salary Review: Yearly
- Festival Bonus: 2