![]() ![]() Ka’iu Kimura is executive director of ‘Imiloa Astronomy Center, a Hawaiian cultural and astronomy education center in Hilo, Hawaii, that brings together members of the Hawaiian and astronomical communities to share a common vision for the future. Bekijk alle kortingen voor studenten en werknemers.Alles Elektronica en Accessoires weergeven.APEX Data Storageservices Backup Target.Our company ultimately cut the contract and went with AWS's managed airflow called MWAA, which is a way superior service if you basically just need the service to be hosted for you without much DevOps support and experience and you're already on an AWS stack. but Airflow is a open source product, plenty of questions are already answered online. I was communicated by Astro that their biggest selling point is that "their people know Airflow well" and can provide you detailed support. ![]() However they had used some sleezy tactics to pressure us into a pay-per-task model, which is as ridiculous as it sounds. My company originally had a simple license based contract that allowed us to use their image on our hosted AWS kubernetes. Hopefully it’s not too late for them to get their shit together so they can continue to pay engineers to work on open source.Īstronomer's price doesn't match the service they provide. Most of the leadership have been let go as part of layoffs. On the commercial side they are going through a big identity crisis and are making a lot of mistakes. They did and continue to do a great job on the open source side. It used to be a running joke that 2.0 would not see the light of day. Their top contributor surpassed Max’s number of commits sometime in 2021, and that person is still working for themĭon’t know if you were around for the 1.9 days, but Astronomer’s investments are the only reason 2.0 came out.Astronomer has the most number of commits by a lot.1/3rd of the PMC members and who knows how many committers work for Astronomer.I feel weird defending Astronomer because there is a lot to criticize, but your comment while true feels disingenuous. ![]() ![]() Some continued with clickstream, others pivoted to Airflow. It started that way, then the company split. Only support I have is the business users who use the platform. The reason I am kind of venting here is I am fighting a lost battle in my org. Kafka allows for processing streaming data. Just changing the owner of the dag let’s the framework know to use the Assigned DB for that owner. Superset allows all the users to Query DBs and create light weight visualizations.Īirflow allows to schedule the python code.Įach user has their individual Database Schema assigned. This allows DS & DEs to access framework components or create their own stuff. I remember in a meeting I said that current solution is completely codebase and Immediately I cld see the lack of interest.Īnyways, the reason I build this is because prior leadership wanted a solution which needed to be cost efficient and could be used by DE, DS & DAs.Īirflow is AD authenticated and each user has a jupyter lab/notebook assigned to them. It is like you cannot use the word Code in any meeting. It has the framework to build pipelines with schema tracking and detect deletion just by passing few parameters. These days customers want a working solution and not only the Platform. If Astronomer creates a framework driven solution which can do All the things ETL tools offer and with bit of good marketing it can successful. The reason why Astronomer is struggling is, it is not like Informatica or Talend. I would be releasing the solution so that it does not die in my current org. It is getting difficult to explain the benefits. The sad part is with change in leadership in my current org there is a push to BUY a solution vs BUILD. Just need to set up the kubernetes or swarm cluster with a shared drive or create one using gluster and run the YML file to deploy the stacks. I have build a solution which is very easy to host and scalable using AIRFLOW, KAFKA, JUPYTER AND SUPERSET. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |