skysight-inc/HackerNews huggingface dataset:
To be honest, even the official guide [1] for BG does not have any information about how to make some info about query cost, budget, and service limits mechanisms [2].

I think the HTTP Archive team could set something in that regard.

PS: When I was an instructor for some cloud training in AWS, the first 2 hours were only to set up billing and budgets to avoid any kind of situation like this. No one would start training without all those locks in place in the first place.

[1] - https://github.com/HTTPArchive/httparchive.org/blob/main/doc...
[2] - https://cloud.google.com/bigquery/docs/best-practices-costs
It’s a code word for communist which is a regressive ideology.
Is this for all of WebKit or the non-Cocoa/Apple builds? It reads like WebKit on Mac (Safari) will not be impacted by this change
It's interesting that some people can't see and/or hear in their memories or imagination. I can tune everything out and see and hear a fully realized other world. I tend to do it without even realizing I'm doing it. As a teenager, I really struggled with maladaptive day dreaming. I've gotten more control over it as an adult, but it's still difficult. There's constant temptation to just withdraw into my own mind.
I must be missing something; doesn't everyone already think their biases are the right biases?
I'm not sure what else you can call a scenario in which LLMs, currently hyped as (among other things) near-term replacements for human workers in all sorts of professions and positions, are not eventually able to satisfactorily (and cost-effectively) replace even the most low-skilled, largely script-driven customer service workers.

The bar I'm setting is far from "impossible"; even human children generally won't seamlessly confabulate when you ask them a question they don't know the answer to. Again citing the recent Air Canada case, these models can't even reliably answer simple questions that are definitively and objectively answered in documentation that is presumably made as freely available to them as is technically possible under the limitations of current technology.
I don’t disagree but how does that work exactly? When you hit the quota the query gets cancelled? That’s definitely already a feature of Redshift Spectrum with WLM. Does BigQuery offer something similar?
Google does provide a way, project owners can set a custom quota to limit costs.
Actually, I retract my earlier statement. I just successfully sent a message on Signal while my phone was turned off. I'm not sure when that changed or if its different on other machines, but I've definitely seen the yellow warning of not being available to send messages on a different computer in the past month or two.
The emotional rollercoaster of hyper-growth startups
>They often talk about how research is just "food for thought" and has little use in any endeavor the requires decision making or informing policy and that truth as a concept is "frowned upon".

If this person really believed any such thing, they would of course never take any form of policy or political action themselves. After all, all those ideas are just for playing with, right? The concept that there exists a truth you could act upon to change things is frowned upon, no?
> It’s common knowledge in many circles that you’ll get different education at Claremont vs berkeley.

Out of curiosity, whats the difference? Both sound like disconnected ivory towers to me...
Ask HN: I plan to relocate to Europe
I am a software engineer with about 5+ years of experience. I am about to graduate with a Bachelor's degree in Sociology and Mathematics. At the beginning of my career, I worked on AI for about 1 year, but after realizing that this field was not for me, I focused on backend development and system design. During the transition period of this career change, I worked on backend development in relatively smaller companies. Then the Fintech sector caught my interest. I have been in the Fintech sector for the last 3+ years. At that time, Blockchain technology and cryptocurrencies were on the rise, and the Fintech companies I worked with were generally developing solutions centered on blockchain technologies.

I live in Turkey and here, especially in the last 3 years, the financial market regulations and national economic management are very strict. In the last month, interest rates have reached up to 45% as a result of the serious rise in inflation. As a result of all this, 2 days ago, my last company, which was on the regulatory side of the cryptocurrency markets, could not withstand the economic trend and financial regulations and went bankrupt.

I think Turkey needs another 1-2 years to sort out its financial problems, but these strict policies are putting tech and fintech companies in Turkey in great danger every day.

For these reasons, I am planning to relocate to Europe considering my industry experience. I am also aware that the labor market has been struggling for the last 1 year, especially for tech companies.

What would you do if you were in my shoes? What kind of problems can I face in continuing my career in another country? How should I go about finding a job?

Also, here is my Github account: github.com/egesabanci
An Introduction to Flow
> One elephant per year of glycine into an ocean 12 times the volume of Earth's oceans is not sufficient to sustain life".

This reasoning is too limited IMAO. Titan oceans may not have whales, but for sure could still afford a lot of animals.

1) It seems that Titan has been there since the early phases of solar system creation, so I'll assume that is older than 3 billions of years (to pick a conservative value). One elephant a year for 3 billions of years is still a lot.

2) Titan could have been bombed with much more matter on the early phases of solar system history.

3) Live on earth is perfectly able to cope with a poor nutrient aquatic environment. Most of the earth falls exactly on this category after all.

4) Some life forms need just a little bit of carbon to be functional. Earth has very big animals that are 99% water.

5) Cold water promotes slow metabolism. Life just adapts growing really slow, being carried by currents, and adopting a poiquiloterm life style.
> Gov needs it to be "voluntary", or else they could be sued for compensations.

Gov makes the law. They could just as easily make a law saying "no compensation shall ever be payable from anything todo with National Service"
Bitcoin wallets are collections of private keys and corresponding public keys. They may or may not also be linked together hierarchically using ECDSA math, and possibly encrypted as well.
Disclaimer: Happy paid kagi user for over a year now.

Why would they offer this for free for small websites? This isn't some VC-backed company getting ready to data-mine us and collect users for enshittification purposes, and in general, Kagi is the site people recommend when they say "if you're not the customer, you're the product".
To prevent a bad PR like this? When it goes viral, most customer supports escalate it to a higher level then they just eventually cancel the bill.
> If Joe Biden changes his heraldry, it doesn't change my post office experience one whit.

Tiny in comparison, but don't government offices feature a portrait of the president in the entryway?
Most of the use-cases for requiring a phone number to sign up for a service e.g. Twitter, Signal seems to be to avoid spam. Atleast allegedly!

What alternatives can be used instead, something that is easily accessible/available to the general public but not easy to obtain to create mass users?
I'm not sure if it's a big deal for business, but for my bachelor's thesis, we showed how we could use a type of counting bloom filters (mentioned in the blog) known as Spectral Bloom Filters, for client-side searching on static websites. Basically, it means doing all the searching and ranking directly on the client side, without needing to send any requests to the server.

https://pncnmnp.github.io/blogs/spectral-bloom-filters.html
"Self-driving" is just "reactive" with an open recursive structure. In principle, a network that processes a prompt, generates a plan, recurses a finite number of times, judges how well it did, generates a training plan to improve, outputs a corresponding follow-up prompt, and then waits for you to press a button before it repeats the whole thing with the follow-up prompt, ad infinitum, is still "reactive" - but nobody would argue that whoever presses the button is performing irreplaceable cognitive labor.

So I just don't think this captures an important distinction at the limit. If a system can generate a good action plan, turning it into an agent is just plumbing.
I get that you're angry, but I don't know you, I'm not angry at you, and my name is Thomas.
What is "the whole thing"? Did HackerNews readers write the article?
What backend is your site made with
The takeaway is to avoid using Snap. In case you needed another reason to.
>An issue with doing a COVID-19 challenge trial that I heard from someone in this space at the time: Nobody actually knew how much virus to administer. We weren't sure of the normal quantity of COVID-19 a person typically inhales before becoming sick.

I dont think that is accurate. You dont have to know the actual viral quantity transmitted to create a representative transmission event. That is to say, if you know people can catch covid sitting side by side, that can be your challenge.

Even if the scenario isn't perfect, you still know how many people caught it vs placebo.
The reasons are probably quite complicated, because some of them are bound by hard technical limits to how quickly a system can react and thus make a hard limit actually a hard limit, but realistically that's largely solvable just by making it a softer hard limit (eg you set a limit of $1000 and the terms say you pay that plus whatever is used before the limit kicks in. More that $1000 but way less than $14000).

All of those technical reasons aside though, the commercial reason is obvious - people's mistakes and overages are a great source of revenue and profit. Companies refund the times where it'd be enough to lose the customer, or when it hits HN, but they make more money every time someone pays up. They have no incentive to fix it. It's part of the business model.
Waiting for the sci fi movie
> because they were used in inputs, the whole model is infringing

That is a nonsense argument on its face, but:

> because the model can be coerced into producing a copyrighted output

That is an extremely good argument. In fact it's almost completely damning, unless you can show that "being coerced into it" means re-introducing enough information in the input that the model's infringement is mostly a regurgitation of that input. But it's clearly not, if you can simply ask it nicely to reproduce an entire text and it does so.

> Individual outputs from a model can be claimed as infringement (for example, the Mario reproductions) against any user that publishes those works

How is that different than operating MP3.com, or a Warez site? The same argument would say "it's the downloading user that is infringing, not the platform!" But clearly that hasn't held up. Consider ChatGPT as a platform hosting a ton of copyrighted material that it produces for you if you ask it nicely, and it's clearly in a much worse position than MP3.com was. ChatGPT is itself publishing those works. Even if it's not hosted online, publshing the GPT model means publishing a huge collection of copyrighted works. I don't see any way around it.
>Best read this closely first, before the article. At bottom, it's a demand that the administration cede power to faculty, on multiple fronts.

Sounds good. Administrators have often been the most petty of tyrants in academia, and faculty self-governance is a more original founding principle of university life than administrative ideological governance.
I learned of that billing limiting mechanism after the $14k was charged to my account. As designed.
it sounds like you're trying to say "PCI switch" without saying "PCI switch" (I worked at Google for over a decade, including hardware division).
Yes. They seem to gate on a feature-by-feature basis, know when you bought the license, and you don't get access to the new features after 1 year (unless you're on their subscription plan). You do continue to get the latest app, which includes bug fixes, but the features released past expiration aren't available to you. https://dueapp.zendesk.com/hc/en-us/articles/360053244591-Wh...
Falsehoods Junior Developers believe about becoming Senior
In 1995, it wasn't an Adobe product. Macromedia was a thing.
Agreed. Seems like web search implementation (both from Kagi and all its competitors!) could be almost endlessly improved upon, and any non-search feature is at odds with that.

Maybe there’s an argument that people who might use this, might also be people with sites that’d be valuable to index, and thus it’d both be nice for them and improve search for all users? :)
> although the audio is superfluous.

It's so funny how subjective that is — I liked the audio enough to tell the author about it in a DM. Then I come to HN and read that someone disagrees. :)
Yeah this is super confusing revisionist history.

Even The Social Network had a scene where a young Dakota Johnson was telling to Sean Parker about how addicted she was to Facebook.

Facebook was absolutely as addictive to young tech-savvy consumers at the time, as TikTok is today.

The only difference is this was pre-mobile. So they were doing it from their laptops, not from their phones wherever they were.

source: i was there, i was one of them.
Think it just depends. If they're, you know, writing a little sketch or something that fits into the constraints of the format, that's obviously more artful than cutting out a 15 second funny Family Guy clip.

But I think the bigger issue is that these platforms actually incentivize creators to conform to their formats. Look at the weird little "genres" that have popped out of TikTok / YouTube Shorts / Instagram, like short videos of some (usually stupid) "tool hack". These kinds of things do numbers because they're exactly what the article describes - a 15 second rush of "interesting."
Only problem: it's an actual mouse, not a computer peripheral.
This isn't true. Benchmarks do not define the usefulness of the models. Mixtral is much more useful for me right now than GPT-4. Look at LLaVA, or the new one, and the very impressive LWM (the text-only version is LLaMA2-based with a 512K context, which does not require TPU to run the inference). The fine-tuned LLaMA 34B is much faster than GPT-4 Turbo and less annoying, providing pretty impressive quality of results.
The Antidebate: Experiments in Art of Sensemaking for World Gone Slightly Mad
>It’s a moment of fulfillment for me today, as Perspectiva releases its short documentary about the creation of the antidebate into the world.
I expect the consumer would much prefer to keep up with friends than some random performer. But friends don't want to create content anymore. It's a production problem. People don't want you, a casual onlooker, to know what is going on in their life. When they do, they will invite you into a private space. This is why Facebook moved to allow most activity to happen in private (chat, groups, etc.).
Glad I'm not the only one who is thoroughly tired of this second coming of the financial system except with bonus insane energy waste and an absolute obliteration of consumer protections at seemingly every tier.

A security product built by people who have zero understanding of actual financial security and how financial crimes actually happen. Truly astonishing.
Early Kagi adopter here. I love Kagi search and their summarisation features, but I'd rather they just focus on high quality and configurable search and summarisation results rather than new products.
It's pretty much like how the article said. The cloud local SSDs are notably slower than what you'd get in an ordinary laptop, let alone a high-end server.

I'm not an insider and don't have any exclusive knowledge, but from reading a lot about the topic my impression is that the issue in both clouds is the virtualization overheads.

That is, having the networking or storage go through any hypervisor software layer is what kills the performance. I've seen similar numbers with on-prem VMware, Xen, and Nutanix setups as well.

Both clouds appear to be working on next-generation VM SKUs where the hypervisor network and storage functions are offloaded into 100% hardware, either into FPGAs or custom ASICs.

"Azure Boost" is Microsoft's marketing name for this, and it basically amounts to both local and remote disks going through an NVMe controller directly mapped into the memory space of the VM. That is, the VM OS kernel talks directly to the hardware, bypassing the hypervisor completely. This is shown in their documentation diagrams: https://learn.microsoft.com/en-us/azure/azure-boost/overview

They're claiming up to 3.8M IOPS for a single VM, which is 3-10x what you'd get out of a single NVMe SSD stick, so... not too shabby at all!

Similarly, Microsoft Azure Network Adapter (MANA) is the equivalent for the NIC, which will similarly connect the VM OS directly into the network, bypassing the hypervisor software.

I'm not an AWS expert, but from what I've seen they've been working on similar tech (Nitro) for years.
I have seen a number of pieces claiming that there are no biological differences between men and women that would lead to men having a clear cut advantage in athletic competitions.
tbh, I have worked with AWS for at least 10 years, and recently their field support are quite prone to help avoid those scenarios (e.g. helped to save hundreds of thousands in a single-digit million account).

This was one of the main selling points for all portfolio companies of the group to adopt AWS in their digital transformation projects.
yeah, but don't "eat up your quota" seems rather tame, whereas "you can get billed $14k with no warning" is the truth.
An unhappy customer won't come back.

The OP is probably a good person with strong interest in data science and building projects.

If it'd be "oh here's your $500 charge, upgrade your quota for more, 'ok fair enough, I did a mistake'", but $14k is not ok without explicit quota upgrade.
There’s that old joke that computer scientists think any numbers within a power of two are equal, physicists think any numbers within a power of 10 are equal, and mathematicians only distinguish between finite numbers and infinity.

Edit: and engineers are as precise as they are paid to be.
It's easy to make an enormous query by joining to other data (or to the same data), or reading a lot of data.

A regex query on response_bodies would churn through 2.5TB of data every time it's run.
Learn OpenGL eBook
Under what circumstances is it legal to freeze a child in Alabama? More importantly, why?
Bloom Filters are already lossy compression, so depending on how sparse they are I'm not sure you'll get too much benefit out of it, but maybe I'm just thinking of much, much smaller filters.

BTW we ended up open sourcing that BF library that encodes and decodes filters in multiple languages, the company has been out of business for nearly a decade but the project is still out there https://github.com/EverythingMe/inbloom
Telegram has had all of these features for a while… too bad it isn't as secure as signal or it'd be perfect, since it's also written in a real GUI toolkit and present in distribution repositories.

I do wonder how telegram and signal are planning to finance it long term. Telegram is adding absurd paid features like exclusive animations, which won't earn nearly enough to cover the costs.

I wonder where signal is about keeping the servers up, since they hate federation so much.
Is it? My definition of active, is "do you use Signal as your main messenger or in that ballpark".

If you only use it a couple of times per week you're not really an active users when messenger apps on average get used multiple times per day.

So I don't think I;[m unreasonable at all to compare Signal to the average messaging apps in term of screen time.
I want progress, I hate when people call regression progress.
As a paying customer, I agree that the only thing I care about from Kagi is search, but...I think that there is a very non-trivial chance that in the near future, search almost entirely gets eaten by AI. It makes sense to me that a search company would be exploring AI and its interaction with search. While I hope this doesn't become the main focus (until and unless it has to be), the history of companies like Kodak (who was a "film" company and therefore chose to ignore digital cameras) should be instructive. If they completely ignore the potential replacement to search, they might get good at search just in time for that to become irrelevant.
I am sorry but this seems to be more of a “TLDR; didn’t read;” situation. The http archive clearly mentions that the data is available for offline processing or for querying online on BQ. And in the “Getting started” section of the instructions, it is mentioned multiple times on how BQ will charge you. And even if it wasn’t mentioned anywhere, it’s a little presumptuous to assume a tool for processing data will not charge you money for literally processing TBs of data again and again.

> Note: BigQuery has a free tier that you can use to get started without enabling billing. At the time of this writing, the free tier allows 10GB of storage and 1TB of data processing per month. Google also provides a $300 credit for new accounts.

> Note: The size of the tables you query are important because BigQuery is billed based on the number of processed data. There is 1TB of processed data included in the free tier, so running a full scan query on one of the larger tables can easily eat up your quota. This is where it becomes important to design queries that process only the data you wish to explore

> When we look at the results of this, you can see how much data was processed during this query. Writing efficient queries limits the number of bytes processed - which is helpful since that's how BigQuery is billed. Note: There is 1TB free per month

https://github.com/HTTPArchive/httparchive.org/blob/main/doc...
Companies could make the limit optional and pass 100% of that downside to the customer. 99.9% of customers would opt in.
Ask HN: Anyone else hate company "hack days"
As someone that generally likes their day to day work, and dislikes arbitrarily Mandatory Corporate Fundays, I really just wish companies would stop this hack days nonsense. It just means I'm going to be more behind on tasks I'm already behind on.

To do a hackdays successfully, I find good projects have already had a lot of personal upfront investment before the hackdays project. The hackdays project then assembles a team of potential labor that might (or often not) accelerate the idea to a demo. And then, even if there's a snazzy demo, you have to engage in a tremendous push after the hackdays to turn them into successful projects.

I can just as easily spend my time doing this in normal planning channels. And instead of hackdays, maybe we should encourage prototyping and demos to be part of the normal planning process, not some out of band activity likely to screw up schedules and deliver nothing.

Please, companies, stop these mandatory corporate fundays. And just fix your normal planning processes.
Yes and no, I ran the script before and the fee wasn't that high (they jacked it up last summer). Usually I have to jump through a ton of hoops just to add more CPU cores to my VMs so I "trusted" that GCP would warn me if I ever made an error.

One of the bigger issues is they charged my card before I literally had any notice what the bill was - it wasn't even in the dashboard yet. I would have terminated the script ASAP had I gotten *any* warning.
Curious about conservation of charge - if all dark protons were to decay then there must be also an abundance of dark positrons?