Big Data Framework Engineer
Hyderabad, Telangana, India
Software and Services
The people here at Apple don’t just build products — they build the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that inspires the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it. Imagine what you could do here. At Apple, great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Apple's Global Business Intelligence (GBI) team is seeking an experienced Big Data Frameworks Engineer to build high quality, scalable and resilient distributed systems that power apple's analytics platform and data pipelines. Apple's Enterprise Data warehouse landscape caters to a wide variety of real-time, near real-time and batch analytical solutions. These solutions are integral part of business functions like Sales, Operations, Finance, AppleCare, Marketing and Internet Services, enabling business drivers to make critical decisions. We leverage a diverse technology stacks such as Hadoop, Apache Spark, Teradata, HANA, Vertica, Kafka, Cassandra and growing. Designing, developing, scaling these big data technologies are a core part of our daily job. The ideal candidate for this position will be able think outside of the box and should have passion for building highly scalable fault tolerant resilient platforms with open source technologies. The candidate will be working closely with open source technologies to solve large scale distributed data system problems. The candidate will be responsible for building core frameworks, which will be used by many critical GBI applications.
- Demonstrate strong problem solving skills and analytical skills.
- Good understanding of distributed systems
- Good understanding of distributed file systems. Understanding of file formats (ORC, parquet etc).
- Experience building application using Hadoop and Spark
- Experience with building frameworks or core libraries
- Strong knowledge in Java or Scala
- Experience with Python/shell is a plus
- Demonstrate strong understanding of development processes and agile methodologies
- Strong communication skills. Should be self-driven, highly motivated and have ability to learn quick
Responsible for design, development and testing of core frameworks used by thousands of jobs Use open source technologies in building frameworks Build tools to identify improve job and cluster performance. And improve time to resolve production problems Provide Level 2 support for the production environments Translate complex business requirements into scalable technical solutions. Strong understanding of analytics needs and proactive-ness to build efficient generic solutions Collaborate with multiple cross functional teams and work on solutions which has larger impact on Apple business. Work with many global teams, in US, Singapore and Europe and demonstrate effective communication, both written and verbal, with technical and non-technical multi-functional teams
Education & Experience
Bachelor’s Degree or Equivalent with 4+ years of experience