Data Engineer – Data Integration

Company: IBM Location: Bangalore (WFO) Interview Mode: Virtual Notice Period: Immediate – 30 Days Openings: 25 CTC: Up to 16 LPA We are looking for a Data Engineer with 4+ years of total experience and 3–5 years of relevant experience in data integration. The candidate should have strong knowledge of Ab Initio Architecture including Co-Operating Systems, GDE, EME, and Application Hub, along with hands-on experience in transformation components such as Reformat, Rollup, Scan, and Normalize. Experience with database components like input/output tables, update table, and run SQL is required. The role also demands expertise in handling flat files, Hadoop (Hive), and XML data processing, along with strong knowledge of SQL, NoSQL, and Unix/Linux environments. The ideal candidate should possess good communication, analytical, and debugging skills. Exposure to scheduling tools like TWS or Autosys, understanding of Big Data Architecture, cloud platforms such as AWS/Azure (IaaS, PaaS, SaaS), and data warehousing concepts will be an added advantage. The role involves building and managing data integration workflows using Ab Initio, performing data transformation and processing, working with large datasets in Hadoop environments, optimizing data pipelines, troubleshooting issues, and collaborating with cross-functional teams to deliver efficient data solutions.