USACares Jobs

Job Information

Carpe Data Software Engineer in Lisbon, Portugal

About {Carpe Data

We are a dedicated group of data and industry experts that has our sights set on supporting transformation in the insurance industry. Carpe Data harnesses the power of emerging and alternative data for insurance carriers around the globe. Through access to continuous monitoring and predictive scoring, insurers gain deeper insight into risks in real-time which can significantly enhance many aspects of the insurance life cycle including underwriting, claims, and book assessment.

All Carpe Data employees are currently working from home due to the COVID-19 pandemic with plans to continue to do so until around June 2021. This role will be recruited virtually and this position will start remote until our office reopens safely. Candidates must be located in Lisbon or willing to relocate to Lisbon once our office reopens.

What you Will Do

As a Software Engineer, you will have the opportunity to work within Carpe Data's cutting edge Big Data pipeline, with an initial focus on data integration. This crucial role will require familiarity with ETL and a desire to architect and optimize core features to be scalable for a variety of disparate incoming data sources.

We?re looking for a candidate who is excited to develop and implement new technologies, and who enjoys a fast-paced, fun, and collaborative team.


  • Develop and maintain a Scala/Spark data pipeline using the best data practices

  • Analyze large datasets to identify, parse, and extract structured and unstructured data

  • Create and use algorithms for data analysis and transform, including Entity Extraction, Disambiguation, Proximity, etc

  • Set up, run, and modify our Big Data pipeline

  • Drive a quality testing environment for the Big Data pipeline, including end-to-end testing

  • Create data integration process efficiency by improving automation and implementing dynamic and broadly applicable features

Skills and Experience for Success in This Role

  • Java/Scala

  • Hadoop/Spark and other large data processing frameworks

  • Data-processing algorithms and best practices

  • Data Structure and Data Architecture

  • AWS data processing pipeline: S3, EMR, ECS, Batch, Lambda, API Gateway

  • Experience with GIT or other code repository

  • Experience utilizing third-party APIs including real-time data streams

  • Software development experience in a production environment

Nice To Have

  • CICD (Continuous Integration / Continuous Deployment)

  • Machine Learning/Deep Learning

  • Python knowledge

  • Experience with web scraping, web crawlers, web proxy, HTML parsing, DOM parsing, PhantomJS or other headless browser

  • Experience with Regular Expressions

Why Carpe Data?

We are proud of our commitment to employee development--encouraging opportunities for growth across the organization. We have a strong focus on a collaborative company culture emphasizing teamwork and open communication. We actively strive to create a work environment, fostered by all employees, that provides equal and equitable access to opportunities, develops our people to acquire new skills and/or achieve personal and professional goals, and leverages all perspectives so that everyone feels welcome and valued and can contribute fully to our organization?s success. We embrace our inclusive work environment and welcome members of all backgrounds and perspectives to show up as their authentic selves.

We Offer:

  • Competitive salary based on experience

  • Health insurance

  • Monthly Food Stipend

  • Monthly Transportation allowance

  • 22 days of paid vacation

  • Career-based training

  • Flexible working hours with preferred times between 11-20

  • Work from home flexibility

  • Virtual company culture events such Yoga, Lunch & Learns, Social Justice Book Club, and Annual Hackathon

  • Office perks including stocked snack kitchen with fresh fruit, coffee, juice and snacks, standing desks, and a dog friendly environment