Description:
As a Search Senior Engineer at Elastic's Extract and Transformation team, you'll be working collaboratively in a distributed working environment delivering valuable features for the Elastic Search solution. We’re seeking a versatile software engineer and communicator to help push the product and team to new heights. The team is responsible for data ingestion from a wide range of content sources and our web crawler.
Our Team Style:
- We appreciate articulate and “low ego” people who want to grow as part of a team.
- We welcome diversity in all forms. We embrace strange and risky ideas and appreciate characters of all sorts.
- We hold each other accountable and work to a high standard. We take pride in the frequent, safe, and graceful delivery of innovative and valuable features.
- We embrace open communication and challenge. We appreciate positivity and vigilance and strive for autonomy, trust, and personal and professional growth.
- Our backend stack is in Python, Ruby and Java/JRuby. We welcome any language background with the expectation to become proficient in Ruby/ Python quickly.
What You Will Be Doing:
- Contributing to the development of large-scale applications using multi modal data with LLMs.
- Architect, optimize, and maintain pipelines for processing and analyzing various data, including PDF, HTML, and image formats.
- You will collaborate with and mentor international teammates in a mostly text-based, asynchronous, remote-first team environment with occasional video calls and yearly conferences. You’ll be hands-on with the team and codebase, reviewing work and providing constructive feedback.
- You will collaborate with the team on features, breaking them down into technical deliverables. You’ll act as an important and communicative part of an engaged and spirited team, working with data scientists and product teams to integrate AI-driven solutions.
What You Bring:
- Experience building software using Ruby and/or Python
- Previous experience building and maintaining ETL pipelines and processes.
- Previous experience with operational components of modern web applications including asynchronous job queues, daemonized services, and CI/CD pipelines.
- Previous experience with open source.
- Excellent practical judgment. You know how to prioritize, when to collaborate and ask for help, and when to be independent.
- Measured and articulated written and spoken communication skills. You work well with others and can craft concise and expressive thoughts into correspondence: issues, investigations, documentation, and onboarding material.
- An interest in learning new tools, languages, workflows, and philosophies that can help you grow. You can function well in an environment that drives towards change.
- Experience with multi-modal data, including formats like PDF, HTML, Word docs. Also, general knowledge of tooling and transformer architecture around LLMs.