Skip to main content

Show HN: Orchest – Data Science Pipelines https://ift.tt/3fPh5HO

Show HN: Orchest – Data Science Pipelines Hello Hacker News! We are Rick & Yannick from Orchest (https://www.orchest.io - https://ift.tt/2XRxxBc). We're building a visual pipeline tool for data scientists. The tool can be considered to be high-code because you write your own Python/R notebooks and scripts, but we manage the underlying infrastructure to make it 'just work™'. You can think of it as a simplified version of Kubeflow. We created Orchest to free data scientists from the tedious engineering related tasks of their job. Similar to how companies like Netflix, Uber and Booking.com support their data scientists with internal tooling and frameworks to increase productivity. When we worked as data scientists ourselves we noticed how heavily we had to depend on our software engineering skills to perform all kinds of tasks. From configuring cloud instances for distributed training, to optimizing the networking and storage for processing large amounts of data. We believe data scientists should be able to focus on the data and the domain specific challenges. Today we are just at the very beginning of making better tooling available for data science and are launching our GitHub project that will give enhanced pipelining abilities to data scientists using the PyData/R stack, with deep integration of Jupyter Notebooks. Currently Orchest supports: 1) visually and interactively editing a pipeline that is represented using a simple JSON schema; 2) running remote container based kernels through the Jupyter Enterprise Gateway integration; 3) scheduling experiments by launching parameterized pipelines on top of our Celery task scheduler; 4) configuring local and remote data sources to separate code versioning from the data passing through your pipelines. We are here to learn and get feedback from the community. As youngsters we don't have all the answers and are always looking to improve. August 12, 2020 at 05:24PM

Comments

Popular posts from this blog

Show HN: Infstream – We’re trying to fix video monetization for creators https://ift.tt/34Rcd11

Show HN: Infstream – We’re trying to fix video monetization for creators TL;DR: https://ift.tt/2VFChrA Hi HN – we’re Ben & Callum from Infstream. We’ve always been heavy users of YouTube, for entertainment, education and sharing. Towards the end of last year, we saw more and more horror stories of YouTubers losing their livelihood to the ad algorithm. We decided to build a content-first video platform, which aims to reduce issues by removing advertisers from the equation. Instead, we charge for the content you watch – bold, I know. Instead of paying in advertising and data, users on Infstream build their own streaming package, a channel at a time. Anyone can start a channel (US & UK now, Europe soon) and earn directly from their subscribers. Subscribers pay $1 per month per channel, of which the channel receives $0.75. This all begins from the first subscriber, there are no minimums to start monetization. Channels have total control, and can publish on a daily, weekly or monthl...

Show HN: Teddy Bear Tracker iOS App https://ift.tt/34MIiHn

Show HN: Teddy Bear Tracker iOS App Two weeks ago when walking around my neighborhood I noticed a strange amount of teddy bears placed in the windows of homes. When I got home I searched the internet and found https://ift.tt/2URjc5m describing that this was being done to provide additional entertainment for people going on walks during these times of social distancing. This past week I decided to repurpose some old code into an app that would allow me to keep track of the teddy bears I found while on my own walks. It's quite simple but I hope others can get some enjoyment out of it! :) Here is the Apple App Store link: https://ift.tt/3al5kpV April 19, 2020 at 10:26PM

Show HN: MailPhantom – Keeping your email address invisible https://ift.tt/2Lc2z02

Show HN: MailPhantom – Keeping your email address invisible Been reading HN for some time now, but this would be my first post. https://ift.tt/2zkYqEh Copy and past from the site: ######### The use of unique password are considered best practice, why are we not doing this with email addresses as well. MailPhantom aims to achieve this, with an added benefit, you'll see which service providers or mailing lists are sharing your email addresses. ######### This is basically a MVP, and may likely break somewhere. But if there is a lot of interest I may build/work on it more. I have used it in its current state for a few months now. I welcome any feedback :) ^C May 10, 2020 at 12:59PM