Autodesk Principal Engineer, Big Data (Remote) in Toronto, Ontario
Job Requisition ID #
Autodesk seeks a strong principal engineer and technical leader for an agile team within the Enterprise Data Management (EDM) organization, designated with designing new robust and resilient data pipelines for core datasets in customer domain. These datasets form the basis building blocks for all data scientists and data analysts throughout the organization. This role collaborates with Product Managers, Program/Project managers, Architects, Operations, and the Engineering Team to ensure data pipelines and delivery uses modern, scalable, reliable methods. Communication skills are critical, and you must be comfortable distilling complex technical information to a non-technical audience as well as a technical leader.
Our team is a group of highly collaborative individuals who are excited to solve challenges, and implement cloud based, resilient, available, reliable software. We are comfortable with several languages and paradigms and aim to choose the technology which is most appropriate for the task. We endeavor to automate our tests and deployments end to end. We seek to mitigate existing issues and balance tech debt with the delivery of value to Autodesk. If you can identify with the below traits, we are looking forward to working with you.
Remote work allowed
Designing, architecting, solutioning, and implementing data pipelines for enterprise consumption
Mapping and automating data flows,frommultiplesources
Develop workflows to runSnowflake applications using Airflow and dbt;Apache Spark applications using Airflow and AWS Lambda
Deploy solutions via automated CI/CD processes to execute data pipelines running in batch
Developing,executing,and documentingsoftware solutions to address complex data collection, processing,transformation,and reporting issues
Interpretingand translatingbusiness needsintotechnical requirements
Troubleshootingcode level problems quickly and efficientlyas needed
Participatingin code and document reviews
Strong experience in several of the following: oSnowflake / Snowflake SQLodbtoFivetranoApache Airflow/AstronomeroAmazon EMR, Lambda, S3oPython / PySparkoSpark / Spark SQLoHiveoHadoop
Extensiveexperiencewith a strong focusacross layers ofdataengineering and pipelines
Strong experience in distributed and cloud architecture patterns
Ability to provide detailed architecture artifacts (L1 / L2 diagrams, sequence diagrams, etc.)
Firm understanding of programmingparadigms,their usage,as well as data structures
Effective communicationand collaborationskills,understandinghow to tailor your message to your audience
Ability to fully develop a feature across all data and/orapplication layers frominception
Experience building and deployingdataapplications withAWS
ExperienceimplementingCI/CD and familiarity TDD/BDD, Preferably concrete examples of each
Strong experience designing and using data lakes and data warehouses
Powerful sense of ownership with a bias for actionwhen challenges arise
Ability to work independently and collaborativelyacrossanorganization
Desire to investigate and follow best practices
Experience and familiarity with the roles/responsibilities of Scrum
Eagernessto learnand share knowledge with agoodattitude!
At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.
Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers (Careers%20%3Ccareers@autodesk.com%3E) .
*From the greenest buildings to the cleanest cars, from the smartest factories to the biggest stories, amazing things are created every day with Autodesk. Over four decades we’ve worked together with our customers to transform how things are made, and in doing so, we’ve also transformed what can be made. A car’s performance now inspires the method of its manufacture, a city’s infrastructure helps predict the unpredictable, and the creation of ever-bigger universes shapes ever-bigger stories. *
Today our solutions span countless industries empowering innovators everywhere. But we’re restless to do more. We don’t believe in waiting for progress, we believe in making it. By combining and recombining technologies. By blurring boundaries, reinventing rules, and merging fields. By unleashing talent and unlocking insights across industries. By helping our customers converge on solutions to the challenges we all face today. At Autodesk, we believe that when you have the right tools to work and think flexibly you have the power to transform what actually needs making. The power to design and make a better world for all.