skysight-inc/HackerNews huggingface dataset:
Does the other tool you're talking about that works with Airflow allow you to scale your Airflow tasks based on, for example, the amount of new input data that needs to be processed? That was one of the major challenges we see in bioinformatics workloads. Sometimes you have a few new samples to run and other times there are thousands -- so your task scheduler, although it is centric, needs to have an understanding of the data too.
Continuous Delivery – Going from Rags to Riches
Found something mildly interesting playing around with this. One of the network requests when you ask for audio is this: https://www.google.com/js/bg/Kv2WsNzHE5GULL-TmjqX5N4dnwt4D3c...

Which presents this, in a comment at the top of the returned js:

Anti-spam. Want to say hello? Contact (base64) Ym90Z3VhcmQtY29udGFjdEBnb29nbGUuY29t

That decodes to: botguard-contact@google.com
Anecdote, but I speak Japanese and English both as native languages (learned them simultaneously growing up). I definitely have different personalities in each language, and can attest to both there contextual influences (working in bigcorp Jalan does things to you) and also that inherent influences of the language mechanisms. Japanese is grammatically and structurally built with a control and deference mechanism.
98point6 | Mobile Software Engineer - iOS/Android | Seattle, WA | https://www.98point6.com/

98point6 is building the next generation of primary care by changing the relationship between healthcare and technology. By uniting leading-edge data science with Board Certified Physicians we are working to make primary care more convenient, accessible, and affordable. As we grow, you will have room to grow alongside us and impact the future of healthcare.

Your role and impact:

As a Mobile Software Engineer, you will collaborate with a small tight-knit mobile team to help architect and develop out a mobile client to connect patients with doctors in a streamlined, meaningful way. You will work with our team of data-scientists, doctors and designers to create the best product we can make; and you will be surrounded by people who are smart and passionate about both our social and technical missions.

You can apply here:
https://jobs.lever.co/98point6/73ee1a0a-1552-4033-ad2a-a059e...
I think people downvote when they see "no remote" or similar. I really wish the admins turned off voting in this thread.
XSPF is a format to enable sharing, AKA universality. It does this by defining a list of metadata fields to be used for resolving each track in the local context of the listener.

The UPF "ids" field maps to the XSPF "identifier" field:
http://xspf.org/xspf-v1.html#rfc.section.4.1.1.2.14.1.1.1.2

XSPF is not M3U in any way. From the spec:
http://xspf.org/xspf-v1.html#rfc.section.3.4

3.4 Content resolver

On a surface level you can use XSPF like any other playlist format. Drop a bunch of filenames into an XSPF document, prepend "file://" to each, and you're ready to go. Under the surface there is much more.

The guiding design principle was to separate the functionality of a catalog of files from the functionality of a list of songs. Most software music players on the PC have some sort of cache for file information. This cache stores a list, or catalog, of available files and metadata from ID3 tags and other sources. XSPF is not a catalog format. XSPF exists only to say which songs to play. Almost everything in XSPF is for the purpose of answering the question which resource, rather than the question what is this resource.

If XSPF is not a catalog format, what is it? XSPF is an intermediate format. We expected a new kind of software called a content resolver to do the job of converting XSPF to a plain old list of files or URIs. A content resolver would be smart enough to keep your playlists from breaking when you move your media from /oggs to /music/ogg. It would be able to figure out that a playlist entry by the artist "Hank Williams" with the title "Your Cheating Heart" could be satisfied by the file /vorbis/hankwilliams/yourcheatingheart.ogg. It might even know how to query the iTunes music store or another online provider to locate and download a missing song.

The content resolver maintains the catalog of your songs in whatever format it prefers. It might use a flatfile, a file in the Berkeley DB format, or a SQL database. It might use only ID3 metadata, but it might also know how to query MusicBrainz or another metadata service.

All XSPF user agents are content resolvers, in that they have complete leeway to turn the contents of a track element into a specific set of bytes.

3.5 Fuzzy names

Any given track can be identified in a number of ways. We provided means for absolute identifiers like URIs, filesystem paths and secure hashes, but also for query-based identifiers — free text fields like artist and work title and numeric fields for song length, all of which together should be enough for a good content resolver to turn into files.
> I don't know what you mean. Certainly "altered states of consciousness" alter the operation of this attention schema theory, by altering signal strength of some perceptions and/or impeding the function of the attention schema apparatus somehow. I'm not sure what you think this means for this theory.

I was just saying that subjective awareness doesn't require awareness of the self as observer. One can become engrossed in a movie without constantly thinking about one's place in relation to the movie. But on second thought, I'm probably misunderstanding some aspect of this theory, as this counterexample seems too obvious.

> I and others believe we don't have true subjective awareness.

I'm afraid this just makes no sense to me. Aren't you subjectively aware of the computer in front of your eyes? If you claim to not have "true subjective awareness", I'm curious what "true subjective awareness" would amount to.

An illusion is when our subjective experience of reality does not match actual reality, but to claim that our subjective experience is itself an illusion? That seems like a contradiction in terms.

Anyway, I'm sorry if this is coming across as flippant. I understand where your belief is coming from (I probably had it myself at one point) but it's just not the way I understand the world now.

For me, the knowledge that I have true subjective awareness is a basic first principle, along the lines of "I think, therefore I am". Maybe I'm a brain-in-a-vat and this is all virtual reality, but I'm definitely experiencing something. Are you trying to deny the fact that I have experiences and sensations, or something else? Maybe we're just talking past each other...

Also, what "weak thought experiments" are you referring to?
Yes! There is a need for more people in journalism who understand the principles of data relationships and are comfortable with modern technology. Whoever takes this job or one at another newspaper, here's a subset of my desiderata for modern journalists:

Every article should have machine readable metadata including:

* The author

* The geographic and political point(s) or region(s) discussed in the article

* URLs of related content (serious news outlets need to fight their desire to keep the user from leaving the site)

* A boolean that indicates if the article uses anonymous sources (tools could then filter out such articles when desired)

* Implicit version control showing each published revision of an article and who made the change
Record low is just below freezing? I'm fine with that.
Citrusbyte | Backend Polyglot Engineer | Los Angeles, New York | REMOTE, https://citrusbyte.com

Citrusbyte is a software consultancy that believes in using simple tools to solve problems. We build custom systems for both startups and enterprises.

We have offices in Los Angeles and New York, but we work remotely with people from all around the world.

Our engineers have experience in a consultative environment, excellent communication skills and a desire to work with talented teams building innovative products. We work closely with our clients, sharing our experience and processes to help them define and create their products.

Most of our projects are written in Ruby, so experience in this language is required, but we are looking for polyglot engineers who have a hunger for learning new languages and tools. At Citrusbyte, learning is part of the job, and you should always be able to answer the question: "what have I learned this week?"

We believe that less is more and we vehemently value simplicity. This is reflected in the tools we choose to work with. For this reason we tend to avoid using big frameworks like Ruby on Rails and instead lean towards smaller tools like Sinatra, Roda or Cuba.

We have also done projects in Elixir, Node.js, Go, Python, Lua, etc. And strive to learn new tools and languages everyday. We believe in always choosing the right tool for the job and we are very open minded about trying different technologies.

Visit our careers page to learn more or apply: http://careers.citrusbyte.com/apply/tPTZOv/Experienced-Softw...
SEEKING WORK - Remote

Developer/Manager with many years of programming in different web technologies.

I am specifically looking work in:

- Web Development: PHP Laravel, Django, Flask.
- Automation/Scraping in Python BeautifulSoup, Scrapy and Selenium.

Visit http://adnansiddiqi.me/ to learn more about me and my work.

Thanks
Microsoft Shipping VR Dev Kits This Month, Full Launch This Holiday Season
Thanks for sharing - this is pretty good.

I'd recommend including the actual text next to or below the user's avatar instead of in a separate view.
I think an important thing for a product like this to take off will be integrating a good / open api.
SIMD Widen, Narrow, and Convert for Vector Comming to .NET
> My comment is aimed at dang.

Then please email him and the mods directly at hn@ycombinator.com

ADD: in order to keep a high signal to noise ratio. Comments on stories should be reserved for discussing the contents of the story, not meta issues with the forum. For meta issues either email the mods directly or start a meta thread with a Ask HN: post.

From the site guidelines[1]:

If the original title begins with a number or number + gratuitous adjective, we'd appreciate it if you'd crop it. E.g. translate "10 Ways To Do X" to "How To Do X," and "14 Amazing Ys" to "Ys." Exception: when the number is meaningful, e.g. "The 5 Platonic Solids."

Otherwise please use the original title, unless it is misleading or linkbait.

Please don't post on HN to ask or tell us something (e.g. to ask us questions about Y Combinator, or to ask or complain about moderation). If you want to say something to us, please send it to hn@ycombinator.com.

[1] https://news.ycombinator.com/newsguidelines.html
As someone who personally suffers from chronic pain. Trust me, it's not condescending at all.
3.8/5 is very low? Seems pretty normal to me.
"8 weeks paid maternity / 4 weeks paid paternity leave."

"4% matching 401k"

Thx for mentioning these benefits. A lot of companies miss the mark when it comes to explaining/offering benefits that sometimes are so much more useful than extra cash.
> I think everything I said basically applies to it as well.

TOML is a much simpler format than YAML, and is a dialect/formalisation of INI files which have yet to go out of style. Direct database storage seems like a red herring (why would you want to store a playlist as a json blob?), so does "trivial JS consumption of the file".

[0] the entire spec is 10 pages, and that's with lots of examples, YAML 1.2 is ~80 pages
Here's a video: https://www.facebook.com/dotsmartbraillewatch/videos/1113611...
Kevin Turner isn't really a tech executive; he's a professional big company manager. Prior to MSFT, he spent 20 years at Walmart.
Looks very cool and it definitely addresses a problem that not only many organizations have but also many individuals have. I know personally I have struggled with moving my data out of various services many times before.

The question I would have to you is this: if the API (or however a tap extracts information) for a given service changes, who is responsible for updating the tap, and is there any way to verify that a tap will extract the data correctly and that said tap isn't assuming an old version of the API?

(Sorry if I'm misunderstanding the way that Singer or any of its associated services work)
HTML is based on SGML, not XML.
I've been building ETL tools in my day to day work for the past 18 months and weak types are a disaster. In all of my tools as soon as I extract data, the first thing I do is establish its type. I have great, reusable tools for type conversation that are set by rules for load.

Any CSV you're working with should be properly escaped anyway or you're bound for a world of pain.
SEEKING WORK - Portland, OR or Remote

I'm a polyglot, full-stack developer with 17 years experience. My specialties are Rails, Postgres, Chef, and Angular/Ember, although I'm comfortable on a variety of platforms. I am reliable, easy to work with, quick to turn things around, and a good communicator. I can work solo or on a team, either as lead or a team member. I value client satisfaction as highly as technical excellence.

You can see some of my recent work here:

http://illuminatedcomputing.com/portfolio

https://github.com/pjungwir/aggs_for_arrays

https://github.com/pjungwir/db_leftovers

If you'd like to work together, I'd be happy to discuss your project!: pj@illuminatedcomputing.com
Private car services offer 4 seater and SUVs as well as the typical looking limo. That's what most of their business is... Driving people to and from locations like nightclubs in SUVs.
I'm very seriously thinking about relocating there with my family (we're in France). We're actually going there next week to visit the country and do a reality check about our expectations.

For those who made the move - how was your experience ? IT scene ? Machine Learning related stuff anyone ?
> I spoke about it with Edgar Leitan, who is native Latvian speaker, born in Rezekne, and is Professor of linguistics specializing in oriental languages, in Vienna University.

Is he, though? http://univie.academia.edu/EdgarLeitan says "University of Vienna, Department of South Asian, Tibet and Buddhist Studies, PhD Student"

Nothing personally against him, but "South Asian, Tibet and Buddhist Studies" is pretty far from Indo-European linguistics. Also, it's not unusual that native speakers have craziest ideas about their own languages. You don't automatically gain a deep insight into the history of your language just by being a native speaker.
Hang an iPhone in front of the robot's camera. Run a green screen camera app on the iPhone. Wear green.
Is there a specific reason why drivers side is more convenient? Only because it doesn't make you walk around the car? Mine is on the passengers side and it never even occurred to me that having it on the drivers side would be more convenient.
We've all met developers that were so lacking in the intangibles that (hindsight being 20/20) they probably we not worth the hire/interview. Imagine that with a couple grand flight tacked on. Don't take a rhetorical question so personally.
Same experience here. I wish they would just make Hangouts better rather than splitting efforts across Duo and Allo.

A unified Mobile+Desktop solution is highly required so I can take conversations from one, continue them on another, and then bring them back to the original...which is why most of us switched to WhatsApp.
It's definitely a cool idea.

Unfortunately, since the author doesn't really seem to understand the technologies he's trying to plot (GraphQL is listed as a database? really?), and since he doesn't present any data to back up his assertions, I feel that any (professional) negativity towards this post is fairly justified.
How to Segment NPS for Advanced Consumer Insights
Why, thank you, I speak Russian fluently. It doesn't matter whether the text has been translated from Traditional Chinese or Sanskrit, the issue remains the same: Buddhist terminology is specific to the Buddhist tradition. You will face the same challenge, as long as the language that it is being translated to is not steeped in the same tradition.
> far from everything

Exactly how we like it.
Binti | Software Engineer | San Francisco, CA | onsite, https://binti.com/binti-careers/software-engineer/

Binti makes software for foster care and adoption agency staff to improve their daily workflow so they can make better-informed decisions and spend more of their time actually helping people. Our mission is to find a safe, loving, and stable family for every child.

Our software is used by private adoption agencies in 30 states. We're in the midst of expanding into serving government foster care agencies and are close to reaching two-thirds of the foster care families in the state of California.

We have sustainable revenue, dedicated customers, and ample seed funding from top investors like First Round, Kapor, and Lowercase. We work together in SF and are growing rapidly.

Binti's main SaaS web product is a conventional monolithic Rails/Postgres app that works well for our use case, but remains fun to hack on. We're building the monolith up higher, and looking forward to soon chipping off a service or two. Some of the areas in which we are especially seeking to round out our engineering team include devops, security, and compliance (we're seeking a full-stack engineer interested in contributing in these areas early on - whether or not you are already an expert). We're using Kubernetes/Google Cloud.

We are also hiring an Enterprise Account Executive: https://angel.co/binti/jobs/212262-enterprise-account-execut...

If you're looking to join a small startup that has a large impact, apply online or email us at jobs@binti.com
98point6 | Senior Software Backend Engineer | Seattle, WA | https://www.98point6.com/

98point6 is building the next generation of primary care by changing the relationship between healthcare and technology. By uniting leading-edge data science with Board Certified Physicians we are working to make primary care more convenient, accessible, and affordable. As we grow, you will have room to grow alongside us and impact the future of healthcare.

Your role and impact:

As a senior software engineer working at 98point6 you will get firsthand experience with technologies such as semantic databases, machine learning, and natural language processing; and you will be surrounded by people who are smart and passionate about both our social and technical missions.

You can apply here: https://jobs.lever.co/98point6/f6c0bdeb-5fd5-4af7-b248-306e7...
> I guess if you cut wireless communication and then covered it with a bag it would be ineffective

Just have it send in a heart beat.

> How unhappy are places with security camera setups today and what do they cost?

This seems like the right question.

The cost delta between "some cameras on high-value stuff" and "cameras everywhere" might justify this robot.

But also, the robot can roll up to someone and ask them to present ID. Or to please leave because the building is closing now. This would cut down on false positives (silent alarm triggered by employee leaving work late etc.)

Also, security guards make regular rounds in buildings that, for cultural or other reasons, don't have permanent security cameras. Colleges come to mind for example. It's harder for me to imagine.

At the very least, I could see this being a really compelling value-add for a security monitoring company. Cut down on false positives by prompting people for the ID and doing facial recog. instead of automatically triggering the silent alarm. But also just as a "cool tech" differentiator.

So it's not clear it will replace many minimum-wage workers. But it might replace a few. In any case, a robot like this can be built cheaply enough that there's bound to be a market. The question is just if the market is big enough for VC's to care, I guess.
It feels like Nintendo is really gouging people on the peripherals though. Each docking station is $90, which seems pretty expensive for what's essentially an HDMI port and USB charger, especially just for the convenience of being able to play it in any room at any time. It doesn't take very many of those before you've basically paid for a whole new Switch.
Lively launches to be the Zenefits for health savings accounts
Languages borrow words from neighbours, just as peoples get influences from neighbouring peoples, so it is hardly a surprise that Latvian language has Slavic words - and Russian language has borrowed lots from neighbours, as well as substantial amount of words from English, German and French languages. Not just in 19th century, but for the past 1000 years; a significant impact to Russian language was during the time of Peter the Great when cultural opening brought lots of new words.
What makes this better than existing shopping websites? (e.x. shopping.google.com)
Broad Institute of MIT and Harvard - Cambridge/Boston, MA - ONSITE

Do you want to help cure cancer? Do you care about the mission behind your software engineering?

We are a motivated team of software engineers building scalable tools to analyze massive amounts of genomic data using cloud compute software to process 24TB of biological data daily... and that's just the beginning! We are co-developing products to advance science with the biggest partners in the industry -- working directly with and alongside their engineers.

We are seeking strong software engineers to join our team. We have a flat organizational structure with self-directed, agile teams.

We use Scala, Spark, Akka, React & Clojurescript. Experience in the tech stack or sciences not req'd.

Here is some recent information on our mission: http://www.wbur.org/commonhealth/2016/07/07/precision-medici...

Interested? Please email Amy Massey - massey@broadinstitute.org
I don't use enterprise ETL tools. I pretty much write my own every time and occasionally I'll supplement that with things like Kiba.
Those are the Dalek-looking ones...
Yah I think so too. Super Tangent warning: I recently saw the documentary on Koko the Gorilla and was amazed at her emotional intelligence and communication skills. Why not integrate AI into other animals besides humans?
Doctors and cardiologists are used to false alarms. In fact, according to mine, cardiologists provide more diagnoses of pleurisy than pulmunologists.

If it could be a heart attack, or similar life threatening thing, you go to emergency.
Definitely agree that that is one of the great points with Luigi. Airflow's UI of course blows everything out of the water IMO.

As for organizing your data, my personal and very biased opinion is that version control semantics similar to Git [0] are a pretty good way to help tame the complexity of ever-changing data sets. We already version code, but with versioned data too, now everything becomes completely reproducible.

[0] Our Data Science Bill of Rights: http://www.pachyderm.io/dsbor.html
> * Implicit version control showing each published revision of an article and who made the change

That last one made me laugh. With traditional print, you'd have a newer version of an article (say the afternoon edition) highlight the changes or the newspaper would publish a correction in a separate section of the paper.

You'd think with modern technology there would be a better way of presenting that type of information but it seems like the real response from the publishing industry has been to simply perform ninja edits and hope nobody notices.