Astra DAO is seeking a multi-talented Senior Big Data Engineer to facilitate the operations of our Data Scientists and Engineering team. The Senior Big Data Engineer will be responsible for employing various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java, and C++. This role involves utilizing machine learning techniques to create and sustain structures that allow for the analysis of data while remaining familiar with dominant programming and deployment strategies in the field. Collaboration with coworkers is essential to ensure that your approach meets the needs of each project. Responsibilities Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Building a data pipeline from different data sources using various data types like API, CSV, JSON, etc. Preparing raw data for manipulation by Data Scientists. Implementing proper data validation and data reconciliation methodologies. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the quality of your outputs. Requirements Bachelor's degree in Data Engineering, Big Data Analytics, Computer Engineering, or related field. A Master's degree in a relevant field is an added advantage. 3+ years of Python, Java, or any programming language development experience. 3+ years of SQL & No-SQL experience (Snowflake Cloud DW & MongoDB experience is a plus). 3+ years of experience with schema design and dimensional data modeling. Expert proficiency in SQL, NoSQL, Python, C++, Java, and R. Expert with building Data Lake, Data Warehouse, or suitable equivalent. Expert in AWS Cloud. Excellent analytical and problem-solving skills. A knack for independence and group work. Capacity to successfully manage a pipeline of duties with minimal supervision. About Astra DAO Astra DAO is an automated crypto asset allocator, built on Ethereum to provide advanced investment strategies to retail participants. The innovative model creates a win-win incentive for index investors, creators, and token holders. Astra DAO simplifies passive investing for retail participants by providing an array of Crypto Indices. Astra DAO aims to help crypto investors compete with quantitative investment funds by finding winning investments and trades. #J-18808-Ljbffr
