skysight-inc/HackerNews huggingface dataset:
I built writeup.ai to learn more about machine learning. I underestimated the amount of time it would take (thought 1 month, took 3, classic 3x off) ... alas, the feature creep of my judgement was hard to manage.

I learned WAY more about deploying ML in production environments than neural networks. ML DevOps was surprisingly hard. the ecosystem is a bit fragmented with managing TensorFlow / PyTorch / Docker / Nvidia dependencies. since there's SO MANY ongoing changes they have a lot of out-of-date documentation.

the backbone of the algorithms running this is from gpt-2 (openai's text generation algorithm). i experimented with almost all of the other text models including bert, transformer-xl, xlnet. i looked into ctrl (salesforce). most of them had incredibly high memory requirements, speed wasn't the fastest, or the output wasn't as good as gpt-2. this isn't a knock on the other algorithms, they were designed with the focus of answering questions in test sets (reading comprehension, etc).

i fine-tuned gpt-2 medium w/gradient checkpointing for five different datasets: legal, harry potter, game of thrones, song lyrics, academic research. training was relatively straight forward, but the data scrubbing was incredibly tedious. i'm still training/updating the research models.

reddit has made some amusing harry potter and game of thrones fanfiction w/this so far: https://www.reddit.com/r/FanFiction/comments/d5s9yh/i_made_a...

app hosted on google cloud. everything is run via docker containers (which is also hard w/nvidia). autoscaling on usage. the main inference runs off from either cascade lake (cpu, surprising reasonable performance), k80s, or p100s. i experimented with the speed and profile of them a lot.

open-sourced at https://github.com/jeffshek/writeup-frontend, https://github.com/jeffshek/open

i'm going to write a detailed blog post about the code/deployment/infrastructure soon if you're interested. love to answer any questions and get feedback! thanks!
Please i want 1 karma
A couple months. No side effects at all so far.

When developing this, it obviously refreshed much more than once a minute. Nothing ever led me to believe anything bad was happening. No burn in, no artifacts, no weird behavior at all.

I think the datasheet is being super ultra mega conservative, designed to cover the worst possible unit that they would let past QC being put in a product that would cost billions of dollars to recall. If you got an average unit and you're making one of these things.... you can probably refresh it in a loop for decades and never have a problem. I wouldn't bet billions on it, but I will bet $20 on it.
Thanks! I had a feeling it was Mencken, it certainly sounds like him.
You can combine approaches of course. My main in-home DNS, per the DHCP settings on the wi-fi, is a Pi-Hole. Secondary DNS is the pfSense firewall, so nothing's dead in the water if the Raspberry Pi falls over for some reason.

The firewall has the same DNS block-lists as the Pi-Hole, but also has subscription lists of IPs to avoid. Most of those are spammers or malware, but can include whatever other category of malfeasance you desire.
Same here. I added an email address a few years ago and have received maybe six pieces of spam. Someone added me to a tech related mailing list without my permission, that was only very slightly annoying.
I wasn't - thank you for introducing me to it!
Why kill yourself before thirty?
> Instead, we just go along with this fake-grassroots idea of "oh yeah Amazon is an evil empire"?

Perhaps people really feel that Amazon is an evil empire regardless of this competitor's actions.
AM2R is awesome, but it's actually not a ROM (in the interest in pedantry). It's a fan-made game, and AFAIK it's not able to be played on SNES.
Why is there such a liquidity crunch though?

And why is the fed stepping in when the liquidity crunch could just correct itself via market mechanisms - if the market rate for overnight lending was 9% I assume plenty of organizations would race to take advantage of that

Aside from something that would just naturally correct itself (lenders being temporarily short on cash due to some statistical anomaly), the only explanation I can think of is that some of the lenders believe that some of the creditors are about to default
It absolutely makes sense. All content licenses should be resaleable. But this will have serious ramifications for how we "buy" content.

If you can buy a game, play it for 100h and them hand it off to somebody else who can do exactly the same, with the publisher/developer/store are getting nothing from those transactions, they are quickly going to find another business model. There is no degeneration like there is with physical goods. There is no reason why anybody would prefer new.

And while publishers only lose a potential sale, vendors like Valve actually have to service a new customer (bandwidth, save storage, etc) without extra pay. They're not going to go quietly here.

And that will quickly turn into publishers and vendors both ceasing to sell software licenses. You'll still pay full price, but you'll get 100 days play, or a few years for a multiplayer. Or membership services like Origin Access. Or straight up gaming as a service (eg Stadia).

So while this is great for owners of existing software licenses in the EU, we shouldn't celebrate this ruling. We're about to own even less than we historically have.
Why is AMD making these chips with 14nm transistors instead of using TSMC's 7nm stuff? AMD is only catching up to Intel because Intel's 10nm has been delayed so much, but if Intel can ever figure out their 10nm process they'll be in the lead again.
Under Bryan Bogensberger's leadership, npm lost:

- its CTO

- its COO co-founder

- some fantastic people in the JavaScript community

- a federal labor dispute

- its culture

- its reputation

- its business model to Github
Are you trying to be energy-efficient or are you trying to be cost-efficient? I thought the former but it seems you mean the latter.
I don't want to be old.
Inflation comes from an increase in the money supply. If we printed the money for it, it would cause inflation, but he plans to tax it.

But even if we printed it, it would by no stretch of the imagination cause hyperinflation, just inflation. The M2 money supply -- still an incomplete measure, as there are lots of kinds of money -- in the US is 14 trillion and change, per Investopedia[1]. 12K per year * 350M people in the US = 4.2 trillion more dollars a year. Hyperinflation happens when a regime does something like double the money supply every week.

[1] https://www.investopedia.com/terms/m/moneysupply.asp
The increased supply of UST is another contributing factor, yes. Important point AFAICT is the supply inelasticity of repo funds.
I've found Ka-block! to work well enough that I'm happy waiting until a clear winner between 1Blocker and AdGuard emerges. OTOH, the bigger annoyance has been the fact that none of the vi key extensions for Safari seem to work anymore.
I felt like it was a bit preachy and "only listen to me" kind of a tone. I agree with you. If he had articulated his point better I would have liked it. I really hate the ego of the author to suggest that you shouldn't speak on something and should "mentor someone 'underrepsented'." Sigh. If you put the work into the talk, know it really well, and you're enthusastic, that's what's important. Be there to help others and help them prep. Give talks on how to give a talk.
If I recall correctly, most of Lemos hacks consisted of bypassing weakly secured web proxies to access internal Intranets. If I also recall correctly, he had been working for the Feds for some time, before turning in Manning. As Lamo had been caught trying to purchase drugs online using other peoples credit cards. but never mind, print the legend.
That's a joke. There's so many things we should worry about before "unrecyclable and toxic wind turbine blades" become a major issue. It's such a tiny problem even next plastic shopping bags or water bottles. Everything has some drawbacks, but this is so far down the list it's not even worth thinking about.
Deep learning frameworks for end-to-end speech recognition
*no real wine was harmed in the making of this

This is a fun project we got to work on for a client. It's online and controllable.

UI is React single page app in S3. Using CloudFront with Lambda@edge functions for adding opengraph meta tags to result pages

Backend is Koa/Node.js with MySQL and Redis

Queue Worker is Node.js with gRPC

Hardware Controller is Python with gRPC

Image processing is done with a Lambda function using OpenCV to crop and de-skew photo

Live stream is WebRTC/HLS fallback

The hardware is all powered by a Raspberry Pi 4 connected to an Arduino Micro running Firmata. The live stream is a Raspberry Pi 3 B+ using ffmpeg.
The sequels are as excellent as the first in the series, so if you read the first and really like it, read the others too.
Newer versions of the x265 encoder for h.265 / HEVC video standard get significant speed-ups. I believe Handbrake was recently updated for it.
I wish companies would do away with the "leaving to pursue other opportunities" nonsense and just give no reasons if they don't want to discuss it.

No C-level exec resigns "effective immediately" without either a transition plan in place or something concrete lined up. I get wanting to allow him to say he resigned instead of he was fired, but the silly language of the press release just makes it worse.
My limited understanding is that Amazon is the best when it comes to warehouse work-highest wages, healthcare, etc.

I would love a good review of the warehouse industry. But I think it’s ultimately boring. The few articles I’ve read about Amazon are pretty useless and imagine they are a modern day The Jungle or something. But I don’t think warehouse work is meatpacking.
> C++ libraries etc

We do have limited resources, so we have to prioritize what gets done first. We couldn't have provided good C++ APIs before we were even able to provide good C++. We now do provide a pretty good C++ language experience, but this is still not at the top of the todo list. No one else I've spoken to thinks this is more important than the other work we're doing.

> Actually provide build infrastructure to create NDK libraries that can be shared across Android projects, instead of forcing us to somehow cram library and header files into AAR packages while having build scripts extract them for correct placement where cmake and ndk-build expect to find them. cdep never went anywhere, while conan and vcpkg aren't the right answer when many NDK libraries need Java code to come along due to JNI wrappers for like 90% of Android APIs.

This is what I've been working on for most of the year.

> like how long it took to fix the header files

This only took a single release (the rest of the time was to give users a chance to transition), and we did plenty of other things in the same release, so I'm not sure what you're getting at.

> Easier CMake support for multiple libraries on our projects, which is found lacking versus how easy it is on ndk-build.

Not sure what you mean here, but it sounds like CMake is what you don't like? Just use ndk-build then.
Protecting the Environment in Times of War
Kroger Launches Apeel Produce, and the Impact on Food Waste Could Be Massive
If we all win with more competition, why do so many people have to declare bankruptcy in the US from medical bills? Why are millions of people uninsured or underinsured? Why are prices so high for medical services in the US vs other first world countries with universal healthcare, while outcomes are worse?
I think RPCS3 also uses it in the JIT
Debt is the same no matter where you go. You borrow, you pay, and if you don’t like the terms, borrow from somewhere else. You can’t eat your cake and have it too.
See Elysium and the AI parole officer.
Story is all about his “success” and desire to seek new opportunities- why not a few sentences about the ongoing labor related litigation.
"the absolute inhumanity of mass genocide" - If your focus is "survival of humans as a species", what's so "inhumane" about it? You are focusing too much on the individual human and not on the species.

And of course I wouldn't sacrifice my own life first, since from my perspective that's obviously the most important thing and everything else is secondary. But once my life is preserved, I look at the bigger picture and see that we (I) would obviously be better off if we killed off 50% of the remaining population.

Why is that so hard to wrap your head around? I'm fairly sure you would see it the same way (if you would just admit it to yourself).
Joy and Happiness are fleeting emotions. If you felt them all the time for something, over just a little bit of time you would not.
This is a totally fine and ethical arrangement. What makes someone a bad person is if they see that, for whatever reason, these kinds of arrangements are inadequate to meet the needs of people (and particularly children of people) to have a decent life and they do nothing.

High interest rate loans to people who can never repay them don't do much of anything to help actually lift people out of poverty. Being in the loan business is fine, but accepting a world where a kid's entire life is stunted because of who they happen to have been born to is not.
Shades of LTCM.
The models in isolation aren't useful. The knowledge to create models like them is where the value lies, but it's only possible to generate value if you can do this in a way that is broadly applicable... which is where building systems management partnerships come into play.

Yes, you can argue the point you made, but it's not particularly insightful because the specific IP employed to govern power mgmt at Google DCs is only truly applicable to Google DCs.
or it might not.
How many packages is he taking down with him?
I get what you're saying, but do you really see HN management turning a blind eye to people calling for direct action against Federal agencies when a bunch of Ycombinator startups probably do business with the Feds? Besides, Big Brother is probably reading HN as well.
This is PR, not real life.
Let me get this straight, because Apple is worried I might leak private information to the Extension Developer, they came up with a new "content blocking" scheme that is not as capable so now my risk has increased for every website I visit? I think I would like to take my chances with the Extension Developer.
Show HN: rtwatch. Watch videos with friends via WebRTC, perfectly synchronized
> $3.6 million per 1 billion

How many of those billions are being borrowed?

The Fed is putting up $165 billion to help the market. So we can assume the market is at least that large.

If we use your 3.6 million per billion figure, that's $600 million.

Of course, the fed isn't the entire market, so we're probably talking a rescue worth several billion dollars. Hardly a rounding error.
So if a license is what's on the disc. You can sell a license. The only difference is that it's on the hard disk of your computer. Steam can still ask for a portion of the proceeds as a digital marketplace.
What are you talking about? Zen 2(Ryzen 3000) uses 7 nm.
treat yourself like you would treat others?
This was my first reaction, and I’ve used a slew of web color tools, going back before colorlovers
Had a similar problem, but just do what works for you, i.e. work with other people and be transparent and public about your deadlines/milestones.
Safari is by far the best browser on Mac IMO, I’m glad Edge is coming but it has its work cut out to beat Safari on performance, energy efficiency and integration.
eat less beef, red meat in general. no need to give up anything. just reduce it a bit.
Don't know if they lost anything at all to GitHub (yet).

But let's see how Entropic and GH package registries turn out.
(ICE = internal combustion engine)
Thanks for pointing out the Nano, seems they are pricing it at $99:

https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
Blue was taken
I wonder at what point we're allowed to accuse people of having not read the article.
From what I've read on AVX-512, the big disadvantage is that the AVX-512 instructions are very CPU intensive so the max clock speeds is reduced if you heavily use AVX-512 instructions.

Another disadvantage is that you have to recompile your code to use AVX512 but it seems general enough that compilers will use the instructions (to an extent) without specialized code [1].

[1] https://www.phoronix.com/scan.php?page=news_item&px=GCC-8-AV...
Maybe “he wants to spend more time with family”?
Do the sperm banks add thimerosol or other ingredients to keep sperm fresh? Never know...
No, we're debating whether we should listen to the charlatans that present us our science. Every time I read a pop-sci article and then go check the original research paper I find out that the pop-sci journalist completely misrepresented the research they are writing about, usually due to a mix of trying to get more clicks and Hanlon's Razor (incompetence).

Most people don't have the skills to be able to listen to science. They don't know how to read and interpret and abstract and then dig in further and read an entire scholarly peer-reviewed paper. That's just part of the problem. The other part is that most people are completely innumerate.
A container _is_ a process, just with cgroups associated to it on startup so it has no visibility of other processes in the system (aka. is sandboxed).

So no.. processes haven't failed. Anything that runs on your system is or is part of a process.
There is an entire wind park. Then it must be another story.

Edit: maybe it is this here: https://www.ingenieur.de/technik/fachbereiche/energie/so-win... - apparently after a couple of years, many of the generators have now finally been connected. That would be good news.
You're still not getting it.

It's irrelevant that graphics from 10 years ago aren't as good as they are today because that only matters for games where cutting-edge graphics are part of the selling point of the game (i.e., AAA games). There are plenty of games that don't try for cutting edge graphics and so look the same today as they did when first released, like Cave Story, Celeste, Fez, Braid, etc.

The point the parent was making is that a copy of a game is inherently the exact same as any other copy of the game, which is not the case with physical goods. A physical good, however lightly used, still has some wear and tear when resold, so it is not the same as a new good.
The big problem is that it's not true skepticism, it's false skepticism: https://www.youtube.com/watch?v=5kzZdps9PG4
AFAIK is Threadripper 2 12nm. I guess its because they can deliver very high speed with that process, without cannibalizing the already overtaxed TSMC-7nm Lines.

Threadripper-users dont care that much about energy efficiency - and its a small market, which gets cannibalized by the 3950X in the new generation.
He didn't seem to mind when he was actually running the FBI. So, assuming life-after-death isn't just a fantasy, why expect that he's changed his mind? People usually don't unless forced to do so.
Black people are convicted more for being black than for being poor
> I hear a lot about AVX-512 being really good.

Its a great instruction set, Absolutely great, AVX512 supports gather/scatter, a whole slew of efficient processing instructions, etc. etc.

However, AVX512 has poor implementations right now. Skylake-X is one of the only implementations, and running it drops the clock-rate in ways that are difficult to predict. (One core running AVX512 drops the clock of other cores, slowing down the throughput of the entire server).

Traditionally, the first implementation of these instruction sets always a degree of "emulated". For example, the gather/scatter instructions aren't much faster than load/stores in practice.

So while the AVX512 instruction set could theoretically be efficiently implemented, it seem like Skylake-X's implementation leaves much to be desired. Hopefully future implementations will be better.

------

The other major implementation of AVX512 is Xeon Phi, which has been deemed end-of-life. I like the idea of Xeon Phi, but it just didn't seem to work out in practice.
Apparently it is 7nm.
https://www.tomshardware.com/reviews/amd-ryzen-threadripper-...
The problem is that we're beholden to a Constitution written in a time where personal possession of firearms was a much more practically relevant issue than it is now, and you take the good with the bad. And: there's a lot of good that comes from not cracking the Constitution back open and mucking with it.
Seconded. Bulma is the tool of choice for 99% of my projects. I have all the CSS classes almost memorized.
-1000, I'd guess
one way to effect that directly is to eat less beef, I wonder how many are willing to make that sacrifice?
Excited to share this project I wrote! This would be the perfect way to watch a movie with someone else over a long distance. Every time you pause it stops the server sending out the latest frame.

This is fundamentally different than something like Watch2Gether where you are downloading an already existing file from a CDN. In that case you are just depending on the client side to keep things in sync, with rtwatch there is no way for users to buffer or skip ahead in the video!
The Case Against the Popular Vote
The point is to show by contradiction that "assault weapons" regulations are not based in any systematic or factual threat assessment. There are better arguments in favor of the right to bear arms, this one is directed specifically at how the irrationialities of gun control betray its motivation.
One challenge with AVX-512 is that it can actually _slow down_ your code. It's so power hungry that if you're using it on more than one core it almost immediately incurs significant throttling. Now, if everything you're doing is 512 bits at a time, you're still winning. But if you're interleaving scalar and vector arithmetic, the drop in clock speeds could slow down the scalar code quite substantially.

https://blog.cloudflare.com/on-the-dangers-of-intels-frequen...
How to Build and Strengthen Distributed Engineering Teams – Accidentally in Code
QR Codes on the Command-Line
In most cases your compiler should do the clever work of turning your division or modulo operation into easier to do bit banging... but only if you're operating on a reasonable constant. Powers of two are best but you can do other constant divisions by stringing together 1-latency operations in ways that are still far faster than division.
Seems like a great time to separate the billing of license to play from value added things like data storage & bandwidth.
Could you even imagine what we could do with $100B every day?

My god. They just sit down at the keyboard and print money out of thin air and electrons and give it to any of the 20 biggest banks who ask for it.

We could literally solve every single problem.
Charli Xcx Explains How Streaming Is Changing Songs
Can't read the article because it's behind a paywall, but unfortunately I've come to doubt anything the NYT reports against Trump as they tend to be less than honest about how they choose to report and represent things.
Trapped: Why 300 scientists are locking themselves in Arctic ice