skysight-inc/HackerNews huggingface dataset:
Hi Varrakesh, the reason it is not "well specified" is, that all of your suggestions are interesting to try out and benchmark. Rather than saying "it has to be exactly like this" we have left it more open ended by saying "what would it take to get to 1 billion records per second?".

The answer might be different on different types of hardware, and with different types of data sets, and with different types of data set sculpting. Yes, it is okay to have one benchmark where there are no more than e.g. 255 products, or 255 customers, but then we should probably also benchmark with e.g. up to 65.536 products and 65.536 customers, and up. Part of achieving high performance data streaming is the ability to make your data small.

It would also be okay to use a GPU - although we have not (yet) plans about doing that. Still, it would be very interesting to see what kind of results you could get with that design.

We just have the requirement, that the data streaming engine must not be exclusively designed for this challenge. It must be a reasonably functional general purpose data streaming engine.

By the way, we hope to reach the 1 BRS milestone on a single server, i7-6700 Quad-Core Skylake CPU, with 2 NVME SSDs mounted in RAID 1. 1 GB of memory to run the benchmark app should be enough, but the server will probably have 64 GB by default.
August'19 Startup Funding These 18 startups received at least $100M
On the contrary I'd like them to be genuine.

By fake I mean made to look older than they are; and possibly planted in the caves.

And note I said "not far-fetched"; not likely, just less improbable than previously.
Ask HN: Have you ever tried any MLOps platform from large companies?
For example:

1) Uber’s Michelangelo
2) Facebook's FBLearner Flow
3) Google's TFX
4) Databricks' MLFlow

I'd love to know the pros and cons of each to apply to my team.
"at its current pace it would take the technology department roughly 20 years to audit all reporting entities."

Also, interesting data presented here: http://www.auditor.ca.gov/reports/2015-611/auditresults.html
I d0n't really think it's inappropriate or ironic. I can easily imagine naive scrapers essentially DDOSing google.
If I'm reading you correctly you are arguing to something slightly different than what OP said. OP says that if a company can't go cash flow positive it is worthless, you say there there is always a chance that a company might experience a sudden turn around and go cash flow positive. Both are true.

However, theory and practice are identical only in theory. If there is a company with negative projected cash flows relying on a negative-expected-value project succeeding unexpectedly that company is probably near worthless. If ordinary investors are relying on "maybe things won't turn out the way we expect them to"-style logic to make their investment decisions then the market is doomed.
No, because future attacks wouldn't get any easier. One successful attack is just one successful attack. If your transaction is not worth a billion dollars, you're safe.
Both make sense, thanks. Curious if you've run across good writing or research that explores this problem in depth, definitely interested in reading more.
I was sitting at the kitchen table reading a Usenet group on my ThinkPad. I saw a headline: "WTC?"

I thought to myself, "WTF? That must be what they meant and they misspelled it."

Then I turned on the TV and saw the rest.

Where were you?
Shipping Container Homes for Under $150k
Like this: https://media.giphy.com/media/12NUbkX6p4xOO4/giphy.gif
The deal breaker for me is Teams is unintuitive and has fewer integrations than Slack
What we mean by that rule (general purpose data streaming engine) is just, that the product must be usable for other use cases than just this challenge. You can write your own data streaming engine, but it should be able to handle a wide variety of use cases, not just the challenge use case.

For instance, simply writing a program that loads 1 billion bytes into memory, iterates them and sums them, would not count as a "general purpose data streaming engine". But you don't have to use Spark, Kafka or something like that. You can write your own.
Good news: this already exists since iOS 5: https://developer.apple.com/documentation/foundation/nsubiqu...
VCRs had high rates of adoption but how many homes did you go in and see the flashing 12:00? In the grand scheme of things, not many used it for setting a recording for shows they didn’t want to miss.
You see, my comment was made because I do believe that numlock makes sense. The ANSI layout is wider than it needs to be because of duplicate keys separating the main area from the numpad. Remove those keys, move the numpad further in, put numlock in a more ergonomic spot, and now they everyday keyboard has become more compact, ergonomic, and useful.
Considering the nature of the rest of the comments in this thread, I'm sure this will be completely taboo. There is a strong argument that the three letter agencies let this happen to further the agendas of the monied elite, and the media owned by that same elite class did everything they could to bury the truth. I don't expect this comment to last long here, but it's it no way an absurd assessment of the nature of the event. It's a really sad state of affairs that mentioning straight forward truths about how the monied and powerful control narratives and start wars will get you buried and ostracized.
Did you really mean Turing Award?

Or do you mean "pass the turing test"?
Keeping a Free and Open Internet Starts at the Root
I think you misunderstood. WE will implement this data streaming engine, and give it away as open source ! ... so WE get the bragging rights, you get the data streaming engine.
Electrify America's DC Chargers: First to Charge an 800-Volt EV Battery at 270kw
I might be wrong but aren't real-time areas like WebSockets not really strong points in Rails? I do see that Action Cable appears to have improved, and I don't know at what point performance issues would get in the way, and I also probably don't know about some potential solutions. Should one choose Rails for an application with significant real-time / reactive functionality?
What's the point of having a debate? GPT is proprietary IP belonging to a private company. They can release it or not as they please, regardless of whether their stated reasons are valid.
I woke up to my radio playing the Howard Stern show where he was talking about the crashes. For more than a bit I was very confused... they were making sense but it just didn't make sense. Didn't last long but it was a very surreal experience.
Exactly ;-)
You don't have to finish with the same amount you started with. If you aim for finishing somewhere between $2m and $0, you can spend between $40k and $100k per year.
When you think about scaling your service or application, don’t forget about how your logs will grow. Think about this impact on CPU and disk usage. If you wrote your own agent to ingest your logs, don’t forget to scale up your logging service.

Source: peak traffic event... person who did back of the envelope math based on p99 request size forgot about logs and specifically the increased log event volume.

Machines were about to tip over. I recall having to ssh to hosts to manually kill the log agent process because the logging ingestion service was shitting itself (not properly throttling either) and we had no other levers in place. Lolz did I mention deleting logs on live hosts because logs were just accumulating and not getting cleared off? Now imagine this across 20,000 hosts. Teehee.
Scripting is only one use of python, it's also a math language that is used for implementing servers, machine learning and statistical analytics, data processing pipelines, and more. Numpy/Pandas allows fast math operations because it makes python the interface for operations implemented on c-arrays underneath the surface. For many many people, python is the primary programming language. The ability to use the same language for scripting as for your primary application is part of the charm of python.

The existence of the cloud means that you can scale wide instead of scaling tall, which makes developer time and complexity management more valuable than hardware efficiency. Python is optimized for primary applications in exactly that kind of environment, where the performance characteristics of something like C++ don't make up for the clumsiness of the language.
Running YouTube at a massive loss for a decade to prevent anyone else from competing in online video

How is that different from what every VC does?
Demonetization is in service of advertiser prerogatives. YouTube would monetize every video if they could because it would make them a lot of money, they don't do so because advertisers do not want to advertise on controversial videos. YouTube loses a ton of money when they have to stream HD video to millions of viewers for free. Additionally, advertisers are not prohibited from working directly with publishers and this is actually pretty common.
What's the real-time / reactive story looking like for Rails these days? Should one choose Rails for new real-time apps?
You should read Philip K Dick.
To be a bit more specific, the ASIC is a computation built in hardware. It can do that computation and that computation alone. The algorithm in Bitcoin does absolutely nothing useful -- you are just hashing a random number and seeing if the result is below a certain value. Since you can't change the computation on the ASIC, it's absolutely useless for anything except mining bitcoins.
It’s crazy how this is happening before bakkt
Why on earth would you think that? The screen readers tie into modern browsers like Safari or Chrome.
A data streaming engine in C/C++ would be very interesting. We have started in Java, but there might be parts it would make sense to write in C++ .

The challenge is not for others to write a data streaming engine to give to us. The challenge is for us to write a data streaming engine and give to you! ... but if you want to try beating the 1BRS milestone too - that would be fun too :-)
Also it’s crazy to send that much at once
While not a web or automated option - if you want to run a quick crawl and scan on your apps you could try OWASP ZAP, it also has quite a few handy plugins - https://www.owasp.org/index.php/OWASP_Zed_Attack_Proxy_Proje...
How The New York Times Broke Harvey Weinstein
Level 3 = Level 2 + WFH.

Level 4 = Level 3 + outsource the status reporting to a local, and simply H instead of WFH.

You have now achieved the goal set by Tim F, and you can replace those cat pics with a real physical cat.
Free Software Costs Something
How do you see it any other way than that you owe them a refund? Have you ever tried to stay in a hotel room that is 80?
No one gets to escape the real world.
They wouldn't be subject to HIPAA, but they would be subject to GINA.

https://en.wikipedia.org/wiki/Genetic_Information_Nondiscrim...
Hah, I love the "GitLab Mature Edition" idea!
If (for example) your AWS bill is higher than your revenue, no amount of growth is likely to make that healthy.

This is almost exactly untrue. Take an old school SAAS company with a few EC2 servers, paying say $500/month. If they have one customer paying $30/month they'll make a loss, but if they grow that customer base above 17 customers they'll be in profit.
delete your computer
My dad woke myself (an 11 year old) and my two brothers (5 and 6 respectively) up, and explained what had happened. It was all we could talk about or focus on, and school ground to a halt for most of that day
> C, Forth, Lisp these were all "first era" languages. Each had a chance to be used, to grow, to spawn other languages.

Do you have any idea of how much is there from Lisp in e.g. Javascript and Python? With the only exception of prefix notation - there is a LOT of things directly inspired by Lisp in many modern languages.

Comfortable to the most number of people? Following the same logic we can conclude that Mandarin is the most comfortable spoken language, because it's the most common language on Earth.
Absolutely, but if you plan on doing this from 30 to 85, say, then it probably won't make much difference, and you might as well save the lions share for medical bills, rainy days or even inheritance down the line.
Why is that? I tried watching the Angry Nerd review of Jaguar and it was all negative. Is it because it had some good under-utilized hardware?
The article has photos from inside the bunker during the actual crisis. Who took the pictures? It seems that VP Cheney’s official photographer went into the bunker with him: On July 24, 2015, the National Archives and Records Administration released 356 photos shot on Sept. 11, 2001, by Vice President Dick Cheney’s official photographer David Bohrer. The publication was the result of a decade-long fight by Frontline to gain access to the images.[1]

[1] https://time.com/3975126/dick-cheney-9-11-photos/
They still scrape and index sites blocked by robots.txt, but they often don’t display those sites in their SERPs (but sometimes they still do)
This is true, but only technically. Google won't actively scrape anything disallowed in robots.txt, but those resources can still be indexed if found in the many other ways Google aggregates data, all of which is automated.

Robots.txt isn't something that bars access to information. It's just a notice that the administrator does not want large amounts of queries against certain resources.
I'm going to piggy-back on this about a certain way information may not add up. I live in Boston, and so do my siblings. We all worked downtown. On the day of the marathon bombing, I immediately called my sister on her cell phone to see if she was okay. Someone that was not my sister picked up, then immediatly hung up after I said who I was looking for.

I was immediately terrified. What if my sister had been hurt, dropped her phone, and it was now in the hands of an opportunistic lowlife? But no. That wasn't it at all. It was instead, that the overloaded cell network, instead of just failing to connect my call, instead, misconnected it.

That was a failure mode I had not predicted. In the end, all my people were fine. But I was shaken. And of course, many other people were not fine.
Last day of the dinosaurs' reign in stunning detail
Sorry maybe I wasn't clear. I don't mean to say that there should not be a focus on member (employee or otherwise) happiness. Actually quite to the contrary. Co-ops do a much better job of aligning incentives for all stakeholders (especially worker-coops in the case of employees) and most track engagement as a business metric. I totally think that simply being a cooperative makes the business model more defensible, I just think it is not the only differentiator needed. So if you are a b2b saas business that just so happens to be structured as a worker-coop or a media outlet that is owned by media producers (https://en.wikipedia.org/wiki/Associated_Press). It just boils down to designing around a business case first, then adding the layer of mutual aid.
The chemistry in this synthetic leaf is much simpler and more controllable than in any GMO. It's not a replacement.
I had read, and maybe I'm misguided, that the law in the US was that you could listen to this stuff as an experiment with your amateur radio license and mess around with all the decoding you wanted... It was just illegal to disclose to anyone anything you heard or read. Actually I don't think the amateur license may have had much to do with it at all, but anyway... I played with it for a minute and mostly saw automated messages about housekeeping needs, but I did occasionally see names, some kind of ID number but I don't think it was a SSN, and sometimes little "love you" notes and quite a lot of "please call me back". I got pretty bored with it pretty quickly that day.
Fuck censorship, it is for dolts.
He should open up a Patreon, tip jar, something to get that funded.

Could also delay results, offer reduced temporal precision and other things to differentiate use cases.
AirBnB is a monopoly in an unregulated market. It can do whatever it pleases with little recourse. What are you going to do? Leave. Great, some other sucker will take the bait.

In an unregulated market, they make whatever rules make them the most profit. I quit AirBnb 3 years ago when a $400/night place in NY clearly engaged in false advertisement by stating the wrong room size. It had pungent smell and generally was a hell hole. AirBnB would not refund. That’s the last I ever made a booking to AirBnB.

I really hope governments step up their game and bring some sanity. AirBnB as a monopoly is wrecking havoc to many cities. It’s like a virus.
AI creates new flu vaccine, all on its own
Agreed the differences look small but find a copy of the full article (I would link but I saw a hard copy). The time curve will convince you this effect is real. All participants start at the same place and you see the dose curves move apart over time and very consistently. What definitely isn’t clear is whether vitamin D supplementation is benefiting the participants at all, thanks to their lack of a proper control.

The bone density decreases may look minor on paper but look at it this way: it’s quite possible that a very large cohort of elderly and middle aged people concerned about their bone health (potentially because they were told they have reason to be concerned) have been paying a lot of money annually to actually worsen their situation. That sucks.
>People had strong reactions to books, magazines, radio and TV as they were introduced.

All of those things are enjoyed in your own home without having an effect on others.

I did consider all the language that I used and that was the most diplomatic that I could muster for such pointless and stupid annoyance in the only land area we have that is relatively free of buzzing things.

I'm not a fan of Planes/helis/car noise either, but they are usually going somewhere, so they don't hang in a single area ruining the environment for 20 minutes at a time.

I dread batteries getting even better/cheaper so drones can ruin the environment for even longer.

I wouldn't care about drones if they would only fly in an area for the time needed to transit through that area, but they hover and annoy until the controller finally gets bored of irritating everyone around them.

What is the greater purpose of consumer drones that you refer to that I am overlooking? I mean other than, "wow, I'm controlling a flying thing"?
The details are in the paper, the liquid is mostly one of the copper or iron dyes, which change conformation and provide electrons when lit with sun. There are ones for red spectrum, another for green and yet another for blue, depending on what you want to make.
The other part is substrates for the catalyzed reaction.

They showed making an antimalarial drug among others, which is expensive now and hard to make in GMO due to toxicity.
Actually you are.off the mark. Most of European countries have either a highly government-managed healthcare (eg UK) or one that is heavily regulated as regards pricing and services and where large parts are managed by the state but with some private offers (eg France, Germany, most places). There is simply no civilised country apart from the US where you go for the emergency, get checked and receive an aspirin and receive a $10k bill. There are strict limits to what medical providers, pharmacies and insurance providers can charge. The same insulin shot costs several times as much in the US than in Europe.
This is a good list, although in economic damage terms it's really just the start. Our efforts on this are just becoming public now, but there's a lot more that will come out -- especially in ads, ad serving, and content.
> Personally, I'd counter it was the inequality compression caused by WWII that lead to the prosperity of the 50s and 60s.

I think it was the entire productive capacity of the remaining world being bombed to destruction was the reason the USA experienced prosperity during that period. The US dollar becoming the international reserve currency probably helped also.
One day, perhaps Googlers will reinvent unions and discover what it’s like to have actual negotiating power with your employer. Until then, expect stuff like this to keep happening.
So I guess we should ban HN....
Were they profitable with that model?
Why is this? Massive corruption? Regulation? I'm not disagreeing with your assessment at all.
Ugh, yeah, the more I think about this ruling, the less I like it.

It's actually pretty insane to force a site to serve content. I think both parties are in the wrong here - HiQ for assuming they're entitled to receive a response from LinkedIn's webservers, and LinkedIn for abusing the CFAA to try to deny service rather than figure out a technical solution to their business problem.

In my view:

* The data is public, and free of copyright. If you're a scraper and can get it, you haven't done anything wrong.

* The servers serving the data are still under LinkedIn's control, and they have no obligation or public duty to always serve that content. They could just as well block you based on your IP or other characteristics. If they want to discriminate and try to only let Google's scrapers access the data - what's wrong with that? Scraper brand is not a protected class. Tough taters if your business model "depends" on your ability to successfully make requests to another uninvolved company's webservers.

If I were the judge, I'd throw this out and let LinkedIn/HiQ duke it out themselves - they deserve each other.
No, it’s more akin to standing on the boundary, reading your posters using binoculars.
Wallet BAKKT
Do your homework before the interview and check LinkedIn for promotions. Then ask them about that specifically... why have only x People in the team been promoted in the past few years? Why was Jane Soe promoted to y role?

Bonus is if you reach out to former employees on LinkedIn and ask what it’s like to work there.
> It is pure fantasy to assume we can get universal healthcare without European level taxes

Agreed, but is anyone really arguing this? The US has very low overall taxation rates (as a % of GDP), well below the OECD average. It should come as no shock to anyone that in order to get Euro-level services, we need a higher tax burden. High earners have the most to lose so it's also not a huge surprise it's an especially concerning issue for them. Most Americans (including those that would benefit most from these changes) are not high earners and they will pay a more measured amount.

I'm not an expert in health care cost containment but there are many doctors, administrators, and number crunchers in the industry who think we can get there if we want it badly enough. Over one third of our total health care expenditure is on administration. By some estimates, we'd drop 15% of the cost (in the trillions) overnight with a single payer system. It's a good start.
Wow, I've never heard of that happening. If anyone knows, I'd love to hear a technical explanation of how and why that could occur.
Daniel Abadi also has an excellent paper on column databases: http://db.csail.mit.edu/pubs/abadi-column-stores.pdf He's a great person at giving high level overviews of database systems before digging into the implementations.