Senior Software Data Engineer

ComplexCare Solutions
United States
April 27, 2024
Overview: The Senior Data Engineer is responsible for contributing to data warehouse/lake, data operations organization. They will support existing data operations such as data pipeline, ETL, data lake / warehouse, data structure development, and troubleshooting of data issues. They will be part of the team which is building next generation data & reporting platform. This platform will cater internal business stakeholders and external customers to provide insights & forecasting to understand current state of business, improve decision-making for their tactical and strategic goals & KPIs. This position may require independent work, sharing information and assisting others with work request. Duties and Responsibilities: Work with the agile team to participate in agile ceremonies like grooming, planning, standup, retrospective, demos Actively contribute to grooming, and standup, create & update tasks, estimate and status Write complex queries, stored procedures, functions, SSIS Packages for various job execution Work with data architects and business analysts to create a logical data model and create DDL scripts for physical model creation Design and develop modern ETL framework utilizing tools like ADF (Azure Data Factory), MS-SSIS etc Design and develop ETL pipelines, using SQL, Stored procedures/functions to extract data from various sources and load into warehouse Design STAR or SNOWFLAKE database schema utilizing industry best practices to build Data warehouse, data marts, views, cubes and data sets/products Design and code various data architecture component like data validation, cleansing, de-duping, Symantec layer etc Design and develop data export frameworks to extract data from the warehouse, transform, pre-aggregate, perform calculations and load into various data marts for Analytics use Design & develop configurable data export framework to extract data from Data warehouse and data marts to generate reports for internal and external customers in .csv, flat files and Work on large data to ensure configurable ingestion of data, dynamic rule & validation of data, cleansing, transforming and loading into the data warehouse Design and implement data validation and quality checks to ensure the accuracy and completeness of the data in the data warehouse Build data marts which will be utilized by Analytics tools like PowerBI and work with PowerBI developer to optimize database schema and queries Perform performance of queries and data processing, identify and resolve any issues looking at query plans, create appropriate indexes, resolve dead locks and create table hints Participate in design discussions, data analysis, data model creation etc Product quality design diagrams (using MS-Visio, Draw.io etc) and documentations (MS-Work, Excel etc) Maintain compliance with Inovalon's policies, procedures and mission statement; Adhere to all confidentiality and HIPAA requirements as outlined within Inovalon's Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position; and Fulfill those responsibilities and/or duties that may be reasonably provided by Inovalon for the purpose of achieving operational and financial success of the Company. Job Requirements: Minimum of 7 years industry experience working in data & reporting area, knowledge of healthcare data will be a plus 5+ years working on Datawarehouse, ETL process/pipeline, Data Workflow, Query Plans & Optimization 5+ experience in MS SQL, T-SQL, ETL Jobs 5+ experience in Microsoft tools like SSMS, SSIS, SQL Server 5+ years' experience in writing query plans, indexes etc 2+ years working with Analytics tools (like Tableau, PowerBI - Preferred) 2+ years' experience working on Azure Cloud is preferred utilizing ADF (Azure Data Factory), Azure Delta Lake, Azure SQL Server, Data Sync, Log Insights and Analytics Experience working with Role based security at database, ETL jobs, data exports level Strong understanding of database concepts and schema (like star, snowflake schema) Experience with HIPPA and PHI will be a plus Ability to effectively communicate with internal and external customers Excellent verbal and written communication skills Excellent computer proficiency (MS Office - Word, Excel and Outlook) Must be able to work under pressure and meet deadlines; and Ability to work independently and to carry out tasks to completion following standard accepted practices Education: BS degree in Computer Science or Computer Engineering Physical Demands and Work Environment: Sedentary work (i.e., sitting for long periods of time); Exerting up to 10 pounds of force occasionally and/or negligible amount of force; Frequently or constantly to lift, carry push, pull or otherwise move objects and repetitive motions; Subject to inside environmental conditions; and Some travel (less than 10%) may be required for this position, primarily for training and collaboration purposes. The actual base pay offered may vary depending on multiple factors including, but not limited to, job-related knowledge/skills, experience, business needs, geographical location, and internal equity. At Inovalon, it is not typical for an individual to be hired at or near the top end of the range for their role, and compensation decisions are dependent upon the facts and circumstances of each position and candidate. Base Compensation Range $103,400 - $130,000 USD Studies have shown that women and people of color are less likely to apply for jobs unless they believe they meet every one of the qualifications listed in a job description. If you don't meet every qualification listed but are excited about our mission and the work described, we encourage you to apply regardless. ComplexCare Solutions is most interested in finding the best candidate for the job and you may be just the right person for this or other roles. By embracing diversity, equity and inclusion we enhance our work environment and drive business success. ComplexCare Solutions strives to reflect the diversity of the communities where we operate and of our clients and everyone whom we serve. We endeavor to create a culture of inclusion in which our associates feel empowered to bring their full, authentic selves to work and pursue their professional goals in an equitable setting. We understand that by fostering this type of culture, and welcoming different perspectives, we generate innovation and growth. ComplexCare Solutions is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirement. The Company maintains a drug free work environment for all of its associates, which includes employees, contractors and vendors. It is unlawful for associates to manufacture, sell, distribute, dispense, possess or use any controlled substance or marijuana in the workplace and doing so will result in disciplinary action, up to and including termination of employment or the contracted relationship.