skysight-inc/HackerNews huggingface dataset:
Lot of useful insights in the comments here. I wanted to address one specific comment -

>can't remember the last time I saw a project someone did in R get very much traction anywhere...the only time people talk about R on the internet is to discuss the language itself which is definitely frustrating

There is a lot of R deployed in industry, even in silicon valley, but you have to be in-the-know. R gets plenty of use in statarb & model checking in finance - speaking from personal experience at GS & BofA/ML. My one non-trivial project at Twitter involved working with this team building a model & I remarked - hey this can be done rather easily if you use this library in R - and the teamlead says, yeah that's how we're doing it! But I thought we are a Scala shop, I said. So he says, yeah but imagine building that entire library in Scala from scratch, it'll take forever! So I enquired how he gets it done - you basically spin up a socket server & the jvm sends R commands plus data as payload over the socket, the server runs R and returns the result of the model back as a string, boom done! I said it was kinda janky & he says - I won't tell if you don't ! So that's R for you - it gets the job done & its fast & somewhat messy, but it is used everywhere, yet people won't openly admit to it because its a 30 year old language & we all want to be using the latest & greatest tool.

I now work at a news startup with a few million users, & all of the news personalization is done in R. So when these millions of viewers watch TV, the piece of code that decides which news clip should be shown ahead of which other news clip & which clip comes after - all of that is decided by a block of R code that I wrote. ~ 300 lines of R, uses quanteda, tidytext & parallel under the hood. Pretty much everything I do involves mcmapply, which parallelizes your compute & uses as many cores as you specify. But that's sort of the thing with R - you have to know which functions/libs to use & which ones to avoid. Just switching from tm to quanteda got us a 200% bump in perf. Switching sapply's to mcmapply was another winner. These things aren't documented cleanly - you have to keep up with cran, experiment & see what works best for you.
Any good books out there on “modern” Java that somebody would recommend?
I like Posthog (and ClickHouse).

If the author of this post is reading, just a recommendation - when you write posts talking about performance increases - the reader kind of expects to see some type of before/after graph that pictorially shows the improvements.
Github broken. CircleCI broken. I'm going for a coffee.
This is actually a really cool idea. Looking forward to see how/if it scales up to humans.

Would be a sad but hilarious example of why lab bench testing and testing in humans or animals is such a large gap

Bench:
The worms swim towards the cancer cells on this 3 inch, 2D glass media!

Animal trial in mice:
The worms swim towards the cancer cells!

Humans:
Oh shit the worms are totally lost in this huge space. Also the patient has a lot of worms in their lungs.
That's not how it appears to me.
Spurious correlations are common in medical models not idiosyncratic like in other fields.

Which makes it hard to use models in clinics.

Doctors are smart about this. Every providier we spoke to about survival models based on biomarker data did not want supervised learning models. The explainability, trust, authorization just aren't there and the risk of misuse is too high.

For now, research is a better use case, but less commercial funding.

It is not hopeless, but your basic LSTM is probably not going to revolutionize medicine.
Its one of only a handful of movies to have ever given me nightmares.
Currently though, a lot of Java software is still java version 8 or 11 which Oracle is withholding LTS for commercial customers
Sorry, I don't mean that the actual system is centralized, as in everybody pings back to the same server or organization, but that it shares a similar vulnerability with having the same codebase running in local hardware.

And this isn't even solved by having standard protocols, open source implementations as you mentioned -- only mitigated. OpenSSL was exploited too.
import pandas as pd
import matplotlib.pyplot as plt
import matplotlib.dates as mdates
import seaborn as sn

df = (pd.read_csv("/tmp/overview_2022-03-21.csv") # i just used curl beforehand
.assign(date=lambda x: pd.to_datetime(x["date"]))
.set_index("date")
.melt(value_vars=[
"newCasesBySpecimenDate",
"covidOccupiedMVBeds",
"newAdmissions",
"newDeaths28DaysByDeathDate"],
var_name="Data", ignore_index=False)
.assign(Data=lambda x: x["Data"].replace({
"newCasesBySpecimenDate": "New Cases",
"newAdmissions": "Admissions",
"newDeaths28DaysByDeathDate": "Deaths",
"covidOccupiedMVBeds": "Ventilated"
}))
)
ax = sn.scatterplot(data=df, x=df.index, y=df["value"], hue="Data")
ax.set(xlabel="Date", ylabel="Daily rate", yscale="log")
ax.xaxis.set_major_formatter(mdates.DateFormatter("%b"))
plt.show()

I spend 2 minutes on the pandas part and 20 minutes on the plotting part, which really says it all. Seaborn's support for smoothing is really bad and doesn't play nicely with datetimes for some reason, so if I wanted smoothing I'd need to do it myself. And the other stuff I left out requires going into matplotlib's documentation which I don't want to spend time on.

pandas is as good or better than R's dataframe manipulation, but R's plotting tools are best in class. I hate all the python plotting libraries.
Back in 2016 at least, Stack overflow was container free https://nickcraver.com/blog/2016/02/17/stack-overflow-the-ar...

No idea how much has changed since then
But does anyone like being involved with Oracle? There are other java vendors that offer support.
The opening epigraph of the textbook used by my AP Euro teacher still sticks with me 15 years later: "good history is a well-told story". Teaching the cause-and-effect greatly eases the memorization. Even if you do not remember which year Martin Luther nailed his 95 theses to the cathedral door, knowing it happened after the voyages of Columbus helps point you to the correct year.
EOS, the fastest AI supercomputer in the world
I have more experience than you and agree with what you say. Your guiding principles coupled with 12 Factor are a solid foundation for software development.
We developed a routing table to generate a map of your hardware distributed
Hi guys, we recently developed a routing table accessible from the embedded side thanks Python to generate and visualize a map of your edge or embedded system.

Screenshot: https://uploads-ssl.webflow.com/601a78a2b5d030260a40b7ad/6239ee3495ef783c2e2fe7b9_Routing_Table_Luos.png

With the open-source project Luos, we are trying to code and make accessible CI/CD for hardware projects.

Link to the documentation: https://docs.luos.io/docs/luos-technology/services/routing-table

Could it be useful in the development of your project?
This is racist.
BA.2 is here
If Facebook deciding not to run ads in Basque means that language is being suppressed, then there are larger problems than Facebook's ad policy.
Damn. Neat! I’m going to try this right after this meeting. That is really cheap for an FDA approved test.
> payed (one time)

This is true, but pricing is currently $3/mo, $15/year, $60 lifetime. So the one time payment is larger than most.
this what my company does as well
I doubt this is legal. If your car kills someone, you're going to jail. Mercedes, the company, cannot do jail time; it can at most pay fines - and there's no legal system in the world today that would accept it.

And if it does, we'll just get a few enterprising folks delivering "hitman as a service" in no time at all (driving hacked Mercedes vehicles into people claiming no responsibility).
Forget automation or the complexity of language or interpretation, use of slang.

Simply put social media should not be monitoring content other than graphic ones where it is clearly a violation.

It is only expected to take down content based on government or court orders.

One of the reasons why I have a big problem with social media moderating content is that it provides perverse incentives for the stronger party to stifle freedom of speech. A lot can be left to interpretation.
Yes that’s what I mean about coordination, every team is prioritizing this and coordinating with the battery life optimization team. The aggregate effect is essentially an army of engineers all working to optimize battery life. That’s difficult to compete with, probably even for Android who doesn’t fully control its hardware like Apple does.

It sounds like Librem and Pine, if they haven’t already, should do the same and create a battery life optimization team, responsible for coordinating that effort across hardware, software, internal teams, and external volunteers.
> badly enough to get press attention would be a critical reputational hit

Would it? Equifax basically had the worst possible outcome and survived it just fine.
Ads with words like “kill” should probably be flagged for human review. How can that not be the case?
SAML Jackson -> Samuel L. Jackson

Pretty funny
went to downdetector first but this is betta
And the more ads they check the more non-compliant ads they’ll find. So it would not only increase costs but reduce revenue, too.
I'd imagine the answer largely depends on whether or not your company either builds or buys software.

If your company builds - it's no garuntee containers are used (but it's a choice).

If your company buys software - I highly doubt containers are used at all.
> Airplane autopilots are so simple they they can be implemented with entirely analog circuits.

For reference: https://www.398th.org/Research/B17_AFCE.html
Except unsurprisingly it did take the status page a few minutes to catch up to Twitter and HN.
This is getting too much.I wonder what effects this will have on the reputation of Github. If I am blocked by Github every few days and can't properly operate. I will start looking for a more reliable alternative. And I am just a solo dev that pays $4, what happens to companies for whom time is worth a lot of money? Pretty disappointing.
I'm asking myself why it's pertinent for an employer to know that their prospects are very, very young and I cannot think of any answer that isn't nefarious in nature. Especially seeing as this is popping up in the middle of a fairly large and seemingly effective labor advocacy movement.

Beyond that, the premise seems flawed. Engineers do not function like athletes. They do not need to be prepared early for a peak that will occur in their twenties and may not last very long. Their performance cannot be easily plotted on a graph or measured deterministically and that's not for a lack of executives trying to do so for decades now. As far as I am concerned a sufficiently talented and motivated tech sector employee can achieve "LeBron" level distinction in their field even if they start in their thirties.

I wish all the best for the teenagers involved, and I deeply hope that nobody exploits their potential lack of life or professional experience.
Anyone think the warnings issued of Russia's cyber attacks has any correlation here?
Apple announces new coaching program and features for educators
> * big tech institutions (lots of younger techies support unions, blatantly hate on their big tech employers, etc)

Anyone who works in Tech sees this at just about any All Hands meeting. It's really amazing to watch.
At my workplace we use Docker to run services, but there is no container orchestration like Kubernetes. An AMI bakes in some provisioning logic and the container image. Autoscaling does the rest.

Even without orchestration, I argue containers are useful. They abstract the operating system from the application and allow you to manage each independently. Much more easily than you'd be able to otherwise, anyway.

Plus you can run that image locally using something like docker-compose for an improved developer experience.
Thank you! Definitely a group effort. Two big things that contributed to the choice: We knew we didn’t want the system to have to store memory on each edge so that eliminated a lot of our options. In our experimental learning rule we only had to compare voltages which is actually easier to do if we have two simultaneous networks.
Totally agree. I find it frustrating trying to reproduce other people's work in R. How has this situation has been allowed to continue for so long? It's unacceptable, especially when used for science. It's impossible to replicate anything unless you are lucky enough you manage to find which package version introduces breaking changes and even then this is something you have to do repeatedly for every code break. Even with _renv_ it's a library you have to install within your R environment which is pointless. Where is a dependency solver like conda for R? - Not that it's perfect, but I've been happy with its drop-in replacement - mamba recently.
We can fix that or bend over. If one studies the history of European countries you'll find bending over is the outlier.
Thanks, but that's not really helpful in explaining what it is you are doing to mark the forwarded email as spam to a new mail host. Doesn't marking a message as spam tell the spam system that email user (your original email account used to forward the message) is a spam account?
No one really uses checked exceptions. But I agree they suck, IOException is the bane of my existence. It's the #1 reason why I don't like Rust or Go. Checking errors is dreadful.
HL7. Well-structured. Pick one. The HL7 spec might be a standard, with a specification, but it is not a thing for well-structured data.

For example, FHIR allows you to use a standardised shorthand, with a formal grammar. [0] That grammar is well defined... It also happens not be a regular grammar, and it is entirely possible to construct something that will be both valid and undecidable, ala Perl. Infinite parsing and expansion on finite data.

[0] https://hl7.org/fhir/uv/shorthand/STU1/reference.html#append...
I agree it's on the journalist -- just wondering which statement is most suspected to be untrue.
Why Authorization Is More Than Just Enforcement
> Is HN responsible for every comment?

They might very well be, if it weren't for Section 230. That can change. https://archive.ph/A5PEw https://en.wikipedia.org/wiki/Section_230

> Or is it only ads?

Advertising has been regulated for a long time now, in print, radio & television, so it wouldn't be odd to treat them as special on the internet.
previous discussion: https://news.ycombinator.com/item?id=30674159
By your opinion 90%+ of Java ecosystem is ignorant of proper error handling, which in itself is a statement on how poorly this method of error handling is looked at.
Internet griefers just like to rail against "the media" the way previous generations complained about the weather.
As someone who is responsible for CI/CD...

welp.

I'm thankful that at least I'm not on security investigating the severity of the okta hack.
I'd personally correlate it with their Azure migration. Either that, or recent launches. Stability aside, they've been shipping a lot of changes recently. And more often than not, changes lead to outages.
UPD: Seems I have a better answer - it is computers per se. When I began study of programming I was opinionated on idea to heavily learn system programming - C++, Asm, Rust had not been invented by that time, OS theory and things I have already mentioned. Now I hate all I know about computers and prefer interpret languages like JS. I haven't escaped from the needness to know about how a processor treats that binaries, but it is very boring and fast-obsoleting stuff and I wish I could tell myself younger not to bother about computers but rather to grok data types and algos.
Unable to login :(
> Java values backwards compatibility very highly, so if something runs today, it's likely to keep running without modification on future JVMs.

Then why do I have to have multiple JVMs installed, which I need to go through via trial-and-error, if I'm given some random java application?
>JEP400: UTF-8 by Default

This changes the default charset of the Java APIs to UTF-8.

I read that the Java 8's JVM's internal string representation is UTF-16 [0][1]. Is that still the case after JEP400?

[0] https://docs.oracle.com/javase/8/docs/technotes/guides/intl/...

[1] http://tutorials.jenkov.com/java/strings.html
This has been happening pretty much every day for a long time. Maybe this will push more people towards some decentralization. A self-hosted Gitea instance my organization has been using had exactly zero downtime in the past year. None. Same with our CI system. Yes, I know, GitHub is 10⁹⁹⁹ times larger than our puny Gitea instance, and that's why they're having issues, but why should I care when one is working, and the other one isn't?
Ask HN: Is Snowflake Down for Anyone?
Status page isn’t showing anything, neither DownDetector.

Can’t access web interface, Terraform builds failing. Anyone else who can chime in?
Watched the talk linked on brimdata.io - stoked to see what's coming out. As a Typescript dev like yourself, very interested in how the dynamic types in Zed could be generated into ts, live.
It's not just direct impact, rapid deceleration can also be traumatic to the brain and other organs.

Cars have materials designed to deform in predictable ways to absorb shock and smooth the deceleration process in case of an impact.

Motorcycles have absolutely nothing of this sort. Body airbags can help a lot, but are still far from the safety that a car offers.

Personal opinion: motorcycles, as a means of urban transportation not sports or leisure, are for people who don't have an option and don't value their lives highly enough.
Apple swapped to zsh as the default shell because Bash moved to GPLv3 from GPLv2.
Did this one involve said risk?

Maybe risk to life was eliminated by a combination of low occupancy, trained staff and adequate escape routes so that there's no reason for firefighters to enter it, and the building was essentially designed to be disposable should the worst happen?

I don't see this as a particularly bad thing - if risk to life and neighbouring properties was correctly managed (and it seems like it was here), why not allow this?
From my personal experience, I find that schools often fail to prepare their top students because the exercises meant to teach you how to work hard for real this time are still passable with a last-minute cram session by the fastest students. By the time the assignments are actually too long to be crammed, it's often well past the safety of K–12 education.
No government should buy closed source anything for obvious reasons.
the general public doesn't fly planes, so to them every flight is getting on a plane, falling asleep, and magically teleporting from one city to another. They have no perspective on just how much an autopilot doesn't do.
How do you as a solo developer get blocked on anything related to GitHub? Are you doing all project planning on GitHub without any other copies elsewhere? Most if not everything you do on GitHub could be replicated locally, one way or another.

I can understand the problem for larger development teams, as a lot of communication and workflows can happen via GitHub Pull Requests or similar.
JVM echo system / tools / libraries / performance is awesome. Frameworks like Spring/Spring Boot have made JVM the default choice for many big tech. It is a no brainer and it works. No one will ever get fired for choosing Spring Boot for a new project :)
Bentō could be such a brilliant machine for soundscape design inspiration. Sadly, it is a standalone application.

In some ways it’s more versatile and suitable for workflows that don’t involve a DAW. However, having it available as a VST/AU would’ve opened up countless new possibilities—for example, after seeing the demo video I immediately had a vision of a soundscape that uses a few of those simultaneously, but 1) the app does not let you launch multiple instances of itself; 2) even if that was allowed, orchestrating launching all of them and saving/loading corresponding presets every time would be an obstacle; 3) that aside, playing (let alone automating) all instances when performing or recording your scape would be quite a royal challenge.

And as a minor grumble, unlike VST plugins and audio units commonly distributed as single files that can be manually copied where appropriate, this application needs to be installed (and with root privileges to boot, not sure why that’s necessary).
I guess the word "context" has been misused in computer science. An interface is a computer context. In particular, an interface is full of non-negotiating details. A human context is about why (we need it), what (we want), and how (to achieve the goal at high level). Most details at high level is understood as the ways things can go wrong. This understanding provides context when we later dive into the details.

An interface with all its details is an end product. With literate programming, that shouldn't show up as a single piece up-front. It should be developed with layers, each layer with its context (why, what, how), each layer with design and implementation.

Certainly we still want a view of complete interface with all its details in one place. This is the same as the compiler still wants the entire code in its expected structure and order. That's the job of tangle.
Do we really have a 'world first' here? I remember seeing a "Backlight" documentary on Dutch TV on the subject of Urban Mining [0] in 2015.

[0] https://yewtu.be/watch?v=kxlmTRWeppM
I agree.

In my opinion, drunk driving is solved by city planning.

It's a fight and a half to convince most Americans that it's actually realistic for suburbs or even rural communities to have functioning public transit and walkable distances, even though towns and suburbs built that way exist in America (rarely, but they do exist).

Rural towns with functioning transit and walkable distances include a laundry list of college towns.

Suburbs with these features include a laundry list of inner ring and street car suburbs built before widespread automobile ownership.

Nothing grinds my gears more than hearing someone say "people need to stop moving into my town, the traffic is getting ridiculous." It's not the people that's the problem, it's the unsustainable forms of development that are just seen as normal.
do you think oneweb just bumped into spacex and they haven't considered them before?

evidently spacex's previous proposal had either a technical compromise they weren't willing to take, or it was more expensive than roscosmos.

now oneweb basically has been forced to make a deal with spacex and they don't run a charity, specially now that one of their main competitors is off the market.

I don't know how you go from there to say that oneweb will save money. spacex will make a ton of money, that I don't doubt.
Same here, the workflow is great.
Good <insert any language> coders are generally amongst the best paid ones, but let's be honest an average Java developer is lost if they can't find an annotation to solve their problem. It was the "default mid-tier university language" for a while, and it really shows in quality of people who apply.
Yes, and those reasons are why I mentioned poor design.

This morning I was reminded, my work Mac has a dozen daemons trying to contact things I don't want, such as icloud, itunes, google, etc. A fraction of these are ostensibly useful, but I had to resort to Little Snitch to block them because the OS is read-only, i.e. insanity.

Even the user-hostile mess of Windows allows me to turn off the worse services... although even that is dwindling.
Brain Chemical Helps Signal to Neurons When to Start a Movement