Senior Data Engineer at Lobster Ink Technologies (Amsterdam, Netherlands)

What you’ll doas Senior Data Engineer

You’ll design, create, own, and maintain our systems and service deployments (Azure based)by continuously improvingour infrastructure for better scalability, security, and fault tolerancebased on the DevOps methodology.

You will be part of Lobster's Data Supply Chain team. Our internal mission is 'to understand and share the relation between learning and excellent performance'. Our team supports both internal and external stakeholders with state-of-the-art analytics products. We use the latest technologies to gather insights, leveraging the Microsoft Azure stack and relying on strong software engineering principles to build data products with continuous deployment capabilities.

• Continuously improve our infrastructure for better scalability, security, and fault tolerance


• Integrate DevOps methodology into development, deployment, and operations lifecycle


• Enable rapid deployment of new product features with the necessary safeguards to maintain stability, high availability, and performance


• Design and build modern data pipelines and data streams


• Design and build data service APIs


• Lead the effort of revamping our in-app reporting solution to make the experience more attractive for our usersMaintain and support Reporting & Data supply chain infrastructure and development process automation


• Implementeffective metrics and monitoring processes


• Support other team members by doing peer reviews


• Attend planning, daily stand-ups and retrospective meetings


• Work as part of a cross-functional agile team


• Participate in an on-call rotation and contribute to root cause analysis

What do you need to be great at?

• You’re an engineer with a passion for data, always interested in new technologies, pushing your boundaries and challenging others.


• You have more than 3 years of experience in Azure, CI/CD and processing data


• You care about delivering quality products and have experience with TDD


• Critical thinking and initiative: Hands-on, nothing-is-impossible mindset


• Mental athleticism: Highly analytical and curious intellect


• Superb communication: Ability to articulate technical problems and projects to all teams as well as discuss requirements with internal and external stakeholders


• Pragmatic problem solving: You approach problems with a practical mindset

The qualities we’re lookingfor

• BSc+ Computer Science, Information Technology graduate or equal relevant work experience


• You’re a certified Data engineer with experience in SQL Data Warehouse, SQL Database, Azure Functions, Azure Automation Accounts, Log Analytics, Data Factory, Data Lake, Data Bricks


• Great understanding of data processing architecture patterns (Lambda, CQRS, MapReduce, etc.)


• You have developed solutions consuming events and processing those into client facing reports


• Experience with Power BI, Python, Scripting languages: PowerShell, Shell, NoSQL/SQL databases, Docker, Kubernetes

What you’ll get in return

A unique opportunity to join a rapidly growing value-driven organization that develops amazing products to disrupt the world of enterprise performance!

And next to that:

• An international diverse department of 20+ nationalities


• The latest agile methods and courses


• To ability to work with cutting edge technologies in the identity domain

• A value-driven culture with frequent transparent retrospectives


• 29 days of leave


• The chance to celebrate results and help each other grow by sharing failure


• Excellent working and salary conditions in our awesome office in Amsterdam


• Hybrid working model