skysight-inc/HackerNews huggingface dataset:
Yeah I deployed it to Kubernetes the other day.

I got it up in a few hours, and the included docker (compose) files are helpful, but it was a frustrating experience for a couple of reasons:

* There is some legal issue with the Apache foundation that’s preventing them publishing to PyPi (details about this were lacking).

* As a result, the provided dockerfile uses a very outdated version.

* Installing any missing dependencies means essentially building your own dockerfile anyways: in my case, it was the bane of my life Snowflake DB dependencies...

* Maybe it’s just me, but figuring out how to go from single-container ephemeral deployment to backend celery workers, external DB for persistence and a redos instance for caching (the recommended production setup) was frustrating to no end

* There are hosted versions you can use.

That said, we’re still going ahead with Superset, because it’s an improvement over the costly, ugly and over-opinionated alternative that is Tableau...
My own experience as well as discussing with various leads at other local businesses tell me about 50% of candidate will hard pass take home projects.
That's huge. Sepsis kills so many people each year (something like 6m per year), and detected early it can be addressed.

For US stats, it's like 200,000 people dead per year from sepsis, and $24B expenditure to treat it. Absolutely massive.

https://www.nigms.nih.gov/education/pages/factsheet_sepsis.a...
Yeah, it was pretty bad here last year. I'd let the leaf matter from the previous autumn and didn't mow enough that spring to knock them down in our yard.

And our home is surrounded by public land (Army Corps) that's all forested. So there are a lot deer and other forest critters that visit us daily and bring them in.

This year I got on top of cleaning up our yard, and keeping the grass short so it hasn't been near as bad. I did end up spraying some bug killer right around the house and under our decks. As a result of all that I've not seen a tick on me from any of the spaces shown in the video I made last Spring.

Still have a few "chiggers" out there though, but those can be killed off easy with diatomaceous earth in the early Spring so I'll lay some of that down again next year. I did it about 6-7 years ago and it knocked them down until this year, and it's still not near as bad as it was back then. We have some blackberry and raspberry bushes growing out there and they were covering my shoes and marching up my pant legs when I was picking berries back then.
Thanks. The project is built mainly to solve my own problem that I often receive requests from the business side that they wanna access the data in the production system (We use different RDMS and Elasticsearch) so they can generate some simple charts in Excel and display to the customers. The request is not difficult but we just don't have a system for that. Since then, I have been trying different BI solutions like Power BI, Kibana and some other open source tools. They are either too complicated to setup/use or the license/fee is not friendly enough to me. That's why I build Poli. I want it to be more focusing on easy to use, having an open license and the developer can use SQL to build reports easily for the end users or embed the reports in their systems.
FAQs Are a Code Smell
> Why not?

Because if you are a CS grad with aspirations to be a developer, taking a QA job is about the worst thing you can do. Even if you work at a company where "every path is available" (which is not particularly common), much better idea to get an actual developer job where you'll be working on coding skills.
True , but i can't think of a way in which they used this dominance against others lately. Antitrust action aims to fix competition, and they won't do it if they think it's not broken.
Reminds me of the time Facebook reactivated my account and posted on my behalf when I replied, "No" to their SMS asking me to come back.

Ahh yes, here it was: https://news.ycombinator.com/item?id=16244522
How to Survive a Lightning Strike (2014)
Wear light colored clothes, including pants (long sleeves are less important). Tuck your pants into your socks. Treat your clothes with permethrin (permethrin treatments will persist across several washings) and treat your skin with picardin.

I spend a lot of time in the woods, in tick prone areas, and have a lot of success with the methods described.
I feel like I could write an essay about this.

AGI represents the creation of a mind .... It's something that has three chief characteristics: it understands the world around it, it understands what effects its actions will have on the world around it, and it takes actions.

None of those three things are even close to achievable in the present day.

No software understands the physical world. The knowledge gap here is IMMENSE. Software does not see what we see: it can be trained to recognize objects, but its understanding is shallow. Rotate those objects and it becomes confused. It doesn't understand what texture or color really are, what shapes really are, what darkness and light really are. Software can see the numerical values of pixels and observe patterns in them but it doesn't actually have any knowledge of what those patterns mean. And that's just a few points on the subject of vision, let alone all the other senses, all the world's complex perceivable properties. Software doesn't even know that there IS a world, because software doesn't KNOW anything! You can set some data into a data structure and run an algorithm on it, but there's no real similarity there to even a baby's ability to know that things fall when you drop them, that they fall in straight lines, that you can't pass through solid objects, that things don't move on their own, etc etc.

Even if, a century from now, some software did miraculously approach such an understanding, it still would not know how it was able to alter the world. It might know that it was able to move objects, or apply force to then, but could it see the downstream effects? Could it predict that adding tomatoes to a chocolate cake made no sense and rendered the cake inedible? Could it know that a television dropped out the window of an eight story building was dangerous to people on the sidewalk below? Could it know that folding a paper bag in half is not destructive, but folding a painting in half IS? Understanding what can result from different actions and why some are effective and others are not, is another vast chasm of a knowledge gap.

Lastly, and by FAR most importantly, the most essential thing.....software does not want. Every single thing we do as living creatures is because our consciousness drives us to want things: I want to type these words at this moment because I enjoy talking about this subject. I will leave soon because I want food and hunger is painful. Etc. If something does not feel pleasure or pain or any true sensation, it cannot want. And we have absolutely no idea how such a thing works, let alone how to create it, because we have next to no idea how our own minds work. Any software that felt nothing, would want nothing-- and so it would sit, inert, motionless...never bored, never curious, never tired, just like an instance of Excel or Chrome. Just a thing, not alive. No such entity could genuinely be described as AGI. We are likely centuries from being able to recreate our consciousness, our feelings and desires....how could someone ever be so naive as to believe it was right around the corner?
I rather spend 4 hours doing a project where I can demonstrate my value (architecture, clean code, design patterns, etc) than spending the same 4 hours solving questions on a whiteboard.

Hell, most of the value I bring as a senior is well outside the realm of coding.
> I detest this sense of entitlement that programmers have

I don't agree with all of your post (but do some of it). However at the pace companies are expanding their hiring net, the supply and demand ratios are going to flip sooner or later. The current seller's market isn't going to last and a lot of folks will have a serious reality check.
I don't think the President has been at all shy about this take either, especially with Amazon (see: https://www.thestreet.com/world/trump-vs-bezos-a-history-of-...). Recently the President tweeted a video about the Defense Department's 10 billion dollar contract that was during a segment called "swamp watch".

It's really hard to discern which, if any, of the President's actions translate into real policy decisions.
That's why I have noticed a lot of sites lately don't show a pricing page at all. And no amount of looking and searching through the site will turn up a price list. Just places to sign up to learn more.

But if you google the product name and the word pricing, they will have a dedicated pricing page in the search results that isn't linked to from anywhere inside the site.
Historically, a lot of successful public research was funded by either defense or intelligence agencies. It's hard to escape from "doing skeevy things"
This may have been in the days before you were required to enter the destination up front and could just tell the driver when you got in the car.
Yep, in Italy as well, at least in relatively recent installations.
I definitely feel like there’s this illusion of tech innovation coming from these big companies that suck up all the tech talent, but at end of day the best and brightest are working on optimizing ad clicks (FB, Goog) or getting people to buy crap (Amazon) or working on incremental hardware improvements (Apple).

Wasn't just this sort of thing said about the financial world? (That all of the brains were being sucked up by finance, because that's what paid the most for technical and math talent.) I remember talking to coworkers about 15 years ago, quipping that pretty soon, it would all just be enigmatic, undecipherable servers humming in server rooms, exchanging arcane signals, causing money to move around for inscrutable purposes.

Doesn't this fit the way people talking about YouTube and Google talk about "The Algorithm?" It just means that the enigmatic, undecipherable servers humming in server rooms have also begun to take over media and the culture. It's not just money moving around, commanded by machines for inscrutable purposes. It's now also the information, the connections, and the interactions comprising human culture itself.

Supposedly we're not yet at the point of AGI, but somehow we've already built the tools for the not yet existing AI overlords to control all of humanity. (In pAIperclips, this would correspond to "Release the Hypnodrones!")

If anything, I would hope any outcome against big tech would level the playing field when it comes to attracting talent, and create an environment where working on true “moonshot” tech was not so risky.

At this point, maybe we need all of the talent just to try and keep the "Hypnodrones" out of the hands of evil hackers?
38 years here, I had undergrad in Chem and part of a masters. Had no college classes or experience when I got my first programming job. Always worked at the leading edge of whatever I did and always had success. Was never an issue. Today I wonder if I would have even gotten an interview.
You might enjoy his "Idea Makers: Personal Perspectives on the Lives & Ideas of Some Notable People", which consists of short essays on a few interesting people, some of which he knew personally.
If you write your unikernel in a high-level language then you can mitigate some of your security concerns. The unikernel should only have access to the data it needs to, so doing multi-tenancy or isolation inside the unikernel is probably not what you want: just spin up a new unikernel for each tenant/thing you want to isolate. The hypervisor would provide isolation in this case.

There is a downside, if there is a vulnerability the exploit can probably make hypercalls straight to the hypervisor, but a hypervisor can have less of an attack surface than a full OS.
If you think the link is an article you're in for a pleasant surprise and a very huge rabbit hole. I really suggest you take a look.
Well, it just depends on whether those 50% that take a hard pass are more or less likely to be quality candidates in the first place.
You really think the government run by an administration hostile to tech companies is going to do anything that benefits the consumer? Do you trust any politician to have both the integrity and the knowledge to pass laws that benefit anyone except themselves and their donors?

While tech companies aren’t “becoming politicized” you better believe that the people who don’t share your interest are.
The headline feels like a teaser ad for an episode of Gilligan's Island.
You can already create a synthetic short position on Robinhood using options. Between a wide call option credit spread and a put option on the same date, you can short it.

Selling a call option and buying a put option at the same strike price creates the synthetic short. By buying the call option with the highest strike price for the same date or later, Robinhood lets you skip the safety requirement of holding 100 shares of the underlying stock because you’ve capped your max-potential-loss to a fixed amount. Understand that with shorting a stock, you have limited potential gains and unlimited potential losses.

Example synthetic short with the S&P500 Index ETF ($SPY) at $299/share currently:
Create Call credit spread by selling June 18th 2021 calls at $300 strike for $24.95/ea and buying June 18 2021 calls at at the highest possible strike of $390 for $1.39/ea.
Then buying the June 18th 2021 Put option at the same strike price of $300 for $24.95/ea.
Theoretically, couldn't they still set different terms per search customer? Thus, still favoring themselves
The big tech companies are a major asset to the economy, driving growth and jobs. Breaking them up is a pretty risky proposition.
I have a friend going through something extremely similar, and it looks like one of the toughest fights I've even seen. I think I'll shoot this over to her, maybe it'll give her some hope, as shes been pretty depressed now that shes in her 2nd year of treatment. Thanks for sharing, and good luck with your recovery!
And Janet Reno (who succeeded William Barr) in the 90's, back in the days of the Clipper chip and encryption software being treated as munitions.

https://en.wikipedia.org/wiki/Clipper_chip
It's money laundering of a different sort; the meaningful business activities are not taking place in Mauritius, it is just a post office box and some legal forms, so it is a tax dodge to claim the business is conducted in Mauritius (or any of the so-called tax havens). Taxes should be paid where a business does its real business activities.

Tax avoidance is a huge business, and legions of lawyers and accountants have been employed for generations to find or create these loopholes. While they may be considered legal in narrow terms, they most often skirt the intent of the law.

As the legality of these arrangements is often questionable, it is also right to look at them morally. After all, laws are supposed to be equitable, and a system may be 'legal' while also being wrong, either morally or equitably.

Therefore, while Bob Geldolf's investments by be technically legal, it is still in the public's interest to know about these secretive arrangements, especially since 'Sir' Bob made his public acclaim over his supposed charitable interest in Africa, which is now revealed to be financial above all else.

It's not gossip if it is in the public's material interest.
Doesn't industrial composting use heat to deal with pathogens?
Nextcloud designer here, thanks for the kind words! What’s something UX-wise that you’d like to see us focus on, or where you have suggestions?

If you’re a designer, we’re also always looking for contributors :) https://nextcloud.com/design/
Top apps freelancers need to run a successful business
> Maybe so, but in this case the consumer will benefit. These large companies have been abusing their monopoly or near monopoly status to push their own politics aggressively. It's no surprise that the other side of the political spectrum would react negatively.

At least we can agree this is all political.
When I was a kid my mother gave us kids a tick check every evening when we came inside and tossed our clothes in the washing machine.

Every kid's mom's did that around here. If you spent the night at a friends you'd be getting tick checked :D

When we got to be around 10 years old we had to do the checks ourselves, so it's really a habit now.
FORTRAN is immensely better than most its critics are aware, and it god a lot of solutions right. Already since around 1950 it had the format specifications:

https://www.fortran.com/FortranForTheIBM704.pdf

quite similar to those used later in C (since around 1970) and even Python (since around 1990) and Java... since version 5.0 in 2004.

Moreover, the format specifications were a part of the language, not "just a string that was traditionally not checked" as in C.
They should have bothered 50 years ago, before the damage was done.

Also, the US Supreme Court does not have the power to structurally modify the way the USPTO works and how patents are evaluated.

It stands to reason that the rate of real invention should approach some kind of an asymptotic limit with time. In other words, real invention is far more difficult with time...because we have learned so much already.

The example of the LED PWM control patents demonstrates this well. PWM control of, well, everything, had been known, applied and taught in schools for decades before these patents were ever penned. Anyone with an electrical engineering background who read these patent applications would kick the applicants out the door with a "Nice try! Get the hell out of here!".

Not the USPTO. They took the money and granted several patents. And with that they caused damage to the industry. The only way further damage to innovation was prevented was when a mega corporation took these criminals out by paying them off. That's just terrible. Our patent system should not create such situations. The damage done to innovation is incalculable.
Loved big these tech giants before, because I believed they were the only way to bring trust. Now I see them as bugs to fix, since trust can be done in a p2p way.
You're forgetting it's not actually AI. They'll perform well at whatever task we adequately train them to do. It's an arms race - we train them to defeat anti air traps, the adversary will move the goalpost somewhere else.
Show HN: CoolBeans 2019.06 Released
This is like a secret that unbelievably hasn’t hit the mainstream. If you sweat heavily pretty much no antiperspirant will work as advertised. Some of the prescription brands have you applying the night before and I had some success but they tended to tear up my armpits and ultimately fail. Personally I see a direct correlation between alcohol consumption and sweating. I discovered that as an unintended consequence during a 30 day detox. If I limit my alcohol intake and use just a deodorant I find myself much better off. Worth experimenting with if you’ve tried everything else.
What Is Complexity Science?
It would be nice if the big high-paying tech companies instituted some kind of profit-sharing or internal VC kind of thing. The worst part of working at these places is when you feel like the work you do is kind of pointless and that you are constrained by what management wants you to work on.

Or they could do part time. I'm sure there are a lot of people making $500k/year who would be perfectly fine working two days per week for $200k/year instead.
Honestly, it was more of a symptom of seeing our content posted on here organically and then the accompanying complaints about the paywall from the community.

There's obviously upside to having more eyeballs on our content.
I'm listening to the excellent BBC podcast 13 Minutes to the Moon about the Apollo program, can you guess how many CS degrees worked on programming the Apollo Guidance Computer?

In my opinion, software is more of an art and design discipline than other types of engineering. The traditional notions of what constitutes an engineer do not apply as much to software. This is clear in the fact that we have no formal certification.
> Academic research accelerates innovation, but it requires costly data that is out of reach for most academic teams.

This is true of pretty much any AI research. Look at Puffer[0], which was just on HN a couple of days ago. They're running a free streaming service just to get enough data to train their algorithms, and in fact mention in their FAQ that they would love to use commercial data if they could get it.

Unfortunately, academic and commercial incentives don't really align here. Most commercial entities don't want to share their data because it's valuable to them, and if they let researchers in, they want the output of the research to remain proprietary to their commercial enterprise.

I wonder if there isn't some sort of governance solution to this. Like give companies big tax breaks for sharing their data with researchers, or something like that. Essentially subsidize academia indirectly.

[0] https://puffer.stanford.edu/player/
Funnily I happen to work in the area of metrics and KPIs and for anyone reading this, the scenario you describe is one of reaaaally bad metrics/ KPIs.

Nominal numbers = bad KPI

Ratios = good KPI

"Repair spend / (lost) court filings" is a way better ratio than plain "Repair spend".
Hire with Confidence
What if there was a pool of Interview locations all over major US metros and candidate (ID and all details verified at that location) takes interview from that place and you connect to him/her over via phone/video call ? It can also reduce travel cost to avoid face to face interviews in some roles.
Would you be interested in such solution ?
Here you go: https://www.spacereference.org/asteroid/2019-od
Training data from OSM volunteers, at the very least. Probably both cheaper and higher quality than e.g. mechanical turk.
Invisible Women [Episode]
The EU discussed forcing Microsoft to open up the Office document formats as part of the antitrust remedies they enforced against Microsoft (in the same way that they forced Microsoft to open up the protocols used for Windows Server to communicate with Windows clients), but ultimately they did not do so.
So this would be basically like rumpkernels but with Linux instead of BSD?
As long as Silicon Valley is relevant. The only trend that seems to threaten this is remote work.
I don't trust the government regardless of who is in charge of it. I also no longer trust our big tech companies as they've demonstrated values I don't share: censorship and unnecessary editorializing mainly. Both of which drive companies to operate in a more centralized manner.

In this case, I see the threat of government intervention to be beneficial as tech will have to adapt to circumvent it or a whole new breed of companies will arise that have immunity baked in. Ideally this would be a focus on decentralization so that the government can't intervene in operations at a technical level.

tldr; our current big tech landscape are overly centralized and behaving badly. The government is not trustworthy but a fight between the two will help healthier tech companies emerge.
The degree of saturation on that infrastructure, as well as the quality of its maintenance, are the important things that competition could improve. Allowing resellers on the same ancient, overloaded infra does not make the user experience better.
This is a fun story—but he should've just booked a round-trip rental car, and dropped it off in Dayton anyway. I've done this a bunch of times, and all they'll do is charge you the one-way rate and grumble a bit...

Better to ask forgiveness than permission.
In a few years self driving car will save us.
You are not alone. In fact, the opportunity to learn new things continuously and at a forced rapid pace is the reason I left academia to be a software developer.