skysight-inc/HackerNews huggingface dataset:
I'd be a lot less concerned about more unnecessary captchas and more concerned about what kind of traffic VPN randos are piping in and out of my home ip address.

This could maybe work as a legit region blocking workaround service if the VPN only allowed connecting to popular streaming sites somehow. I don't think I'd trust it though.
When to Take the Plane and When to Walk
Slavic too. In Polish: żegnała (she said goodbye) za często (literally too often, but used here it would convey the meaning and sound more natural than literal za wiele razy).

BTW żegnała encodes the gender. If it was he it would be żegnał. So arguably it's more compressed than latin.

BTW2 the real compression happens in conditionals żegnałaby = she would have said goodbye
What were your test questions?
Depending on the complexity and acuity of the problem, I'm surprised that urgent care providers are willing to make these referrals. It puts them on the hook for reviewing consultation notes and followup results on potentially dozens of visits, time for which I assume they have no capacity to bill, since they are not your PCP and have no longstanding relationship (just an acute care provider). Not to mention a lack of context (no followup visits to see how PT is going), lack of infrastructure for keeping track of consultation results (for us they just show up in a big manilla envelope and need some kind of system for reviewing, scanning, storing).

My system thankfully has great access to PCPs, so I virtually never make a nonemergency referral; coordinating this care is the role of the PCP and entirely outside of my scope of expertise and training. Urgent care seems like a poor replacement for having fair access to a PCP, but maybe that's just like, my opinion, man.
The spirit too... They use Matomo and collect internal analytics only, there are no third-party trackers on these sites...
I don’t think this is a particularly useful benchmark.

It’s well known that LLMs are bad at math. The token based weighting can’t properly account for numbers that can vary wildly. Numbers are effectively wildcards in the LLM world.
So funny thing about software prototypes. Time and again a prototype is pushed into production by greedy management seeking immediate returns - and then the actual system is never done.
Buzzy AI startup for generating 3D models used cheap human labor
except these dietary factors make no sense / change so frequently they are almost science fads. tobacco use has dropped significantly in the last 30 years. sodium is now considered not that important, especially compared to sugar. low in milk contradicts the reality that milk is full of hormones and antibiotics

we do an about face on lots of “dietary risk factors” every 5-10 years
Well yes, hosting is cheap. The majority of expenses for any company comes from employee salaries, payments to vendors and professional services, and you can see exactly that in Wikimedia's balance sheet. So what's the point this piece is trying to make exactly?
The thing about CICO is that it's not a very good scientific model for obesity because it says nothing about hunger or satiety, but tracking calories is useful for ordinary people looking to control their food intake, so it sticks around.

CICO doesn't have any opinion on the relative satiation offered by sugars vs proteins, or bread vs potatoes, but it turns one's diet into a marketplace for satiation, which does teach which foods are the best "value" per kcal (even if a kcal is itself very inaccurate).

Maybe we'll see it as a dated but situationally valid tool, like leeches or "Red sky at night, shepard's delight".
That was very insightful, thanks! I overestimated my numbers apparently.
Nevomo successfully tests maglev on conventional infrastructure
The super-res is surprisingly usable for making sense of land use changes. With OpenStreetMap editing, one common challenge is that out of the usable (license-wise) imagery, the high-defs ones are old and the new ones from Sentinel are low-def. A lot of switching, squinting, and gusssing is required to understand of what's going on, even when most of the work is as basic as trying to spot this old road in the blurry new image. This super-res seems to do that well enough. It doesn't have enough information to guess the exact shape of buildings and that's okay.

They also do some object recognition, which is useful if you're an electric infrastructure nut. It spotted some solar fields in Shanghai which I've never heard of before -- a look at the same coordinates (30.753, 121.392) on Google sure shows the expected blue.
Even staff is not that high.

They have long ago eclipsed the cost of running it and now donate/fund causes that are in line with their views.

https://upload.wikimedia.org/wikipedia/foundation/2/26/Wikim...
Gorm can do this
It seems like the article is written by someone just starting to get into the data engineering subfield and they thought they were going to be writing python (pyspark is my guess) to support some kind of ML effort, but they got saddled with a bunch of SQL/data warehousing stuff to support business intelligence/analytics instead.
I'd say normally what you say makes sense especially when you're pulling in abbreviations that are not related to the topic at hand or you're introducing new people to the field, but ETL is a pretty basic concept in data engineering and it's a web search away (should be the top result), so I'm not sure if it would really add all that much to their article to start with definitions.

It sounds to me like the author got thrown to the wolves in an environment of what data engineering looked like before "big data" and ML took off (and before it was even really called data engineering). There are a lot of enterprises that are still working in this mode because they are not Google and they don't have the same level of sophistication and automation when it comes to this stuff.

There is some bad information no doubt in the article, but if we're being charitable, it feels like it's someone who took a wrong turn somewhere and is struggling to find their feet in an unfamiliar place without the proper guidance and mentorship and that's a bit admirable at least that they're trying on their own.

There is no direct bearing on ETL in the article, aside from the focus on SQL queries and data validation hints that they might be talking about ELT (Extract-Load-Transform) as the level beyond ETL, but it's not clearly explained. It's clear to me that they are at the start of their journey and they are gonna learn things the hard way without guidance from someone more experienced.
That wouldn't skew the resulting average/mean that much, it would just be less accurate for specific localities...
European competitors will pop up to fill the gap it’s not like these giants are really offering anything outstanding anymore for the general public.
code and API calls, like everything else

these libraries make too many choices for the user given the variability, and generally make the most interesting use-cases more difficult. It's like the failed attempts to create a single API for all the clouds, it is impossible. In the long run, they will all get in the way.

What is it about LLMs that makes people think we need something like langchain? A function or package for dealing with vector embeddings, ok, but to wrap API calls... I can write that function myself, I don't need their subpar interfaces for messages and all the things...

Developers want building blocks for LLMs, not a bunch of frameworks competing to be the one that wins by pushing out shitty implementations as fast as possible
You mean how much they pay to Wikipedia's contributors?
Does Microsoft care about F# at all? Wasn't it a short-lived experiment of the 2000th creative era which just happened to attract enough persistent community interest to avoid being archived?
As an outsider I would say Germany has just as recognizable of a food culture, and nearly as much of an alcohol culture.
Looks really nice, but asking me for an account after I click on a category is a huge turn off. Why do I need an account?
I just heard about a jump in atmospheric methane that is not understood.
The oil/gas industry has made some progress to curtail methane emissions so we don't think it is that gang.

I wonder about millions of tons of frozen ancient vegetation in Canada and Russia beginning to rot. ?

One idea is that we have hit the true "terminus" point of the past ice age and temperatures will rise rapidly over the next few decades and then stabilize at the new "normal".

Human CO2 might have pushed temps up but this could be much bigger than we expected.

https://theconversation.com/rising-methane-could-be-a-sign-t...

https://gml.noaa.gov/ccgg/trends_ch4/
Does the new owner of a used vehicle have to sign this too? And if this was skipped during the selling process, is the data now collected in the name of the previous owner?
Ikea has a range of quality options. Some of their budget offering are very poor quality and will eventually fail with even mild use. However, they do also sell some nicer quality furniture that will absolutely stand up to abuse.
I considered the price as well. I do love open source designs more than I love the design of the ZSA Voyager (it has too few thumb keys), but in terms of price, it might actually be fair. Milled steel cases for a Corne or Lily58 are only available via group buys that charge $300-400, and they don't come with either keycaps or switches. I believe it's realistic that you could pay the same amount or more for an alternative.
That seems very sensible: in the United States driving is massively subsidized but even with so much general fund revenue we have more road infrastructure than we can maintain because cars don’t scale well. Shifting the cost back to the direct users will both provide desperately needed maintenance funds and reduce congestion by deterring low-value trips.
Is that the option that comes to mind when presented with the facts?

That's your reaction. Not mine. Who am I to tell people what to do or not do?

You could just as easily have read what I said and thought: "So we need to prepare for something even worse no matter what, and we also need to act much more aggressively than we are!"
I just asked GPT-4 your first question and got this in response. It's still a correct result, but with unnecessary steps:

> Fill the 12-liter jug and pour water into the 6-liter jug until it's full. Empty the 6-liter jug and pour the remaining water from the 12-liter jug into it. You'll have 6 liters in the 6-liter jug.
The gorilla question: what has changed in the past 33 years to cause this increase? I'd look first at confounding variables like 33 years of improved methods to detect cancer earlier: the rise of MRI, screening for chemical signatures of cancer (like PSA), etc.

The abstract didn't suggest the authors filtered out more recent methods of detection from their data (i.e. detections based only on 1990-era tests like physical exam, 2D X-Ray, etc).
While you are right, in order to be able to eat less you normally have to change what you eat.

Many years ago I was obese and it was very difficult to eat less because the junk food that I was buying did not satiate me until eating too large amounts of it.

Now I can easily control my weight and I can have any weight I believe to be optimal, but that is because now I eat only food that I cook myself from raw ingredients and which satiates me in much smaller amounts and I do not feel hungry even a long time after eating.

I have verified that I have not changed and only the choice of food matters, because I have bought some of the things that I liked in the past, and after eating them I was soon hungry like in the old times, despite the big calorie content.

The food that I eat now has a relatively high content of proteins and of healthy fat, and most of the carbohydrates are from starch. I no longer use any sugar in the daily food, I make some sweets at most once per week, but usually more seldom that that.

So while someone who eats "ultraprocessed" food might see a great improvement by just eating less, I believe that it is very unlikely that anyone could succeed to do this as long as they keep eating the same food.
At what point do diminishing returns strike?
> The government need to start teaching about macronutrient breakdowns and calorie intake during early years

Stop looking to the government to solve this problem. There are many many thousands of sources online that one can easily use to get nutrition information.

If you want an example of how NOT to do it, just look at the US Gov food pyramid! Most of that diet is made of carbs.

Edit: I did a search and the first article, albeit from Huff Post, shows the food pyramid - https://www.huffingtonpost.co.uk/entry/usda-dietary-guidelin...
It's still not clear why an app that can be used by at most 50% of people is dominant.
Pretty sure they meant the people who write the software and operate the systems that actually host the site.
…this is an article about France
I agree with most of your points, but with system resources, sometimes it is simply that you can give them, but you can never take them back.
I suspect this is in the news partly due to a recently published book on the subject [1] which has been selling very well.

The book takes a rather expansive view of what counts as 'ultra-processed' - it's not just things like coca-cola and ice cream; apparently Hovis Wholemeal bread and margarine both count as ultra-processed.

[1] https://www.amazon.co.uk/Ultra-Processed-People-Stuff-That-I...
The touchscreens are really a dealbreaker on new cars.

They’re not just prone to quick obsolescence, they’re dangerous.
Can this be quantized to run on a device?
Its not the piece, it’s the editorialized headline. (Now fixed)
I always toss $5 to Wikipedia when they do the annual donation campaign and I don't care where it goes. I like what they stand for and they made high school indefinitely easier for me, I owe em'.
High BMI and high fasting glucose are a main risk factor, they write. Well what about reducing sugar and carbs altogether instead of promoting whole grains as they do?
Why edit the title? This article is barely about the hosting costs. And also yes, it's well-known wiki has very healthy revenue despite it's desperate sounding pleas for donations.
I work for a retailer where the service I’m responsible for is used by every cash register around the world for certain operations. When I came in, the RDS DB for this service had 60GB allocated to it, had literally just run out of space and caused an outage. The last team just gave it an additional 20GB. A month later, I was put in charge of it and it was already 5GB away from running out of space again. I put an end to that and gave it 250GB. The cost is minimal compared to a store not being able to open due to an outage.

The instances for the service itself had 20GB of EBS allocated to them. Luckily they don’t need much local storage. But that’s typical here. There’s a Jenkins instance that is even more of a pain. I’m not responsible for it but every week or two one of the worker nodes runs out of space because they’re given 8GB of storage space. I’m just watching the disaster unfold over the course of a year and a half as I’m constantly telling that team to just up the storage space on the worker nodes instead of constantly having to fiddle with cron jobs.

It’s not even an expense thing. They just… don’t want to increase the storage space. It drives me insane.
... I mean, _as you'd expect_, surely? I can't imagine why anyone would expect this to be a large part of their costs; it's largely a relatively easy sort of thing to optimise (I assume most page views are just served straight from a cache; most users don't log in), and they've had 20 years to do so. As you'd expect, the bulk of its costs are staff.
Check out ice cores.
~100M seems a bit high for that.

WP seems to me to be the most cacheable site in existence, I wonder what 100M worth of staff are doing there.
The biggest problem I have is tracking that the government has access to. We're in a situation where the government knows everywhere your phone has been, and everywhere your car has been. I doubt we're far from the gov't being able to de-activate your car at will also.

I would like to have privacy from corporations, but I really wish we'd keep the focus on privacy from our governments, since they have such ultimate power over us.
Show HN: Abbey – Automate access management to infrastructure with Terraform
Hi HN. We’ve been building Abbey and happy to share our beta with you: https://abbey.io. Abbey makes it easy for engineers to configure how their infrastructure is accessed by other employees in the company. This is especially useful when your company outgrows giving admin access to everyone all the time, typically driven by compliance requirements. With Abbey, you use your existing Terraform setup to configure workflows and policies for how people are granted/revoked access to your services. Your end users then use a web app to request access to resources they need and you can approve/deny access with an audit trail of all access changes.

Why we built this:

I've been an engineer for a long time where operating infrastructure at scale and moving quickly was always top-of-mind. However, after a certain point, moving safely becomes just as important, except I've usually had a ton of friction trying to balance shipping software and adhering to requirements given to me by security or compliance teams. As the owner of infrastructure services, I have the most context into how my systems work, so what I really wanted was tooling that could help me implement the most undifferentiated security/compliance controls so I could work on other things.

What’s in the beta:

- Bring your existing setup, whether it’s Terraform Cloud, OpenTF, Atlantis, Spacelift, env0, or Digger.

- Workflows - for how someone should get access (who needs to review, how many steps, etc)

- Policies - Open Policy Agent policies for granting and revoking access (based on time or if someone’s role or attribute changes)

- Native Terraform output - to keep Abbey off the critical path and so you can avoid vendor lock-in

- Web app - for your end users to request for access and for you to approve/deny requests with an audit trail

- Open API to integrate or build your own UI if you want

- Integrate incrementally - you should continue using your own CI/CD, host your own secrets/repo/terraform state. Abbey doesn’t touch any of that. We're a control plane for your IAM infrastructure that tells your system when it's ok to do the `terraform apply`. This means you can enable this flow for any number of resources.

We're early so we'd love your feedback. Feel free to try us out for free and let us know what you think here or in our Slack (https://join.slack.com/t/abbey-io/shared_invite/zt-22ivaaw75...).

Main site: https://abbey.io

Docs: https://docs.abbey.io
> The odds of that being right are very slim

This really depends on the industry and the domain experience of the team. The deeper the domain experience, the more likely you are to get it right. It also helps to limit the scope of what you do (big part of the Shape Up process). Works well for life sciences, for example, where we're replacing a paper process with a digital process. Not so well for SV startups where first time founders are trying to figure out product-market-fit.

> ...saves a lot of time at project start

Often just shifting the work to a later cycle to get it right.

In life sciences when supporting a GxP process, validation (which is rooted in documentation and specifications) is unavoidable. In that environment, figuring out how to move fast despite the constraints yielded a Basecamp Shape Up like process.

I think every team that believes big-A Agile is The One True Way take a look at Shape Up.
Fun fact: All of Wikipedia (text only, compressed) is like 20 GB
I don't get it... If you have a good reason to use 2 TB, i'm happy to allocate it for you.

If you just "I want 20 GB of storage", i'm not going to give it to you.

Storage is cheap in relation to other things. Just have a good reason to why you need it.
What an amazing comment. Thank you so much for taking the time to write this.
>I'd look first at confounding variables like 33 years of improved methods to detect cancer earlier: the rise of MRI, screening for chemical signatures of cancer (like PSA), etc.

Early detection is one thing, but is cancer generally hard to detect by the time it's fatal?
Hosting costs are small for most sites not doing things like streaming video or data storage. Human costs are high - an average American software engineer is probably at 100k or more, and it takes many of them to operate a site.

This is like saying you wouldn't pay your doctor or barber because the electricity is only 1% of the total revenue.
As long as there is money to be made in the EU market, US tech firms will continue to serve it.

Plenty of US and western companies operate to make a buck in far more restrictive markets around the world.
It cares enough to ship it on VS, and still pay salaries that keep it going.

I expect it to fade into oblivion the day Microsoft decides to drop it.

Those foundation members will hardly keep it relevant, once it becomes yet another third party language on .NET ecosystem.
I think I'm alright - I mean - my FJ Cruiser doesn't even have carpet.
Perhaps a bit less likely, but we'll allow it.
> homemade daal

You can name the ingredients yes? Surely you can because you've put each one in yourself.

> but I can have loads of potato chips

No, because im not convinced you know what Firming agent (calcium chloride) is.

Getting the idea of how this works?

I gave the general public the benefit of the doubt in another comment but now im not so sure.
90 days retention is only 2,160 hours. Even at 999 GB/hr that is only ~2160 TB of storage. So, if we stretch the definition of “multiple gigabytes”, is maybe $100k in storage which is around 3-6 developer-months. If we use a more reasonable definition like 10 GB/hr, then that is 20 TB, so maybe $1k in storage which is around 1 developer-day.

Seems pretty reasonable to me.
You are just saying that it's interoperable as long as you use another service where it is not supported.
If you're interested how they run Wikipedia, their tech docs are public: https://wikitech.wikimedia.org/wiki/Main_Page

https://github.com/wikimedia

Compared to many other stuff I read, it's mostly "boring tech".
I doubt these datasets have anything to do with the "we've been trying to reach you about your vehicle's warranty" calls, as I know people who got a lot of those calls but never owned a vehicle (some were even minors!). Every time I listened to one of their messages it never had any actual targeted car information.
Having read the study, it does have a major flaw in its risk attribution approach, but the global data is pretty interesting, in particular this:

> "In 2019, after breast cancer, the digestive and respiratory systems of early-onset cancer were mainly responsible for the deaths."

However, it's risk conclusion is that "Dietary risk factors (diet high in red meat, low in fruits, high in sodium and low in milk, etc), alcohol consumption
and tobacco use are the main risk factors underlying early-onset cancers." - but, they don't even mention industrial and secondary exposures to carcinogenic chemicals, even though this has been a well-described cause of early-onset cancer for over 100 years, and of course the respiratory and digestive tract - which is where early-onset cancers are showing up - are obvious immediate targets for carcinogenic environmental pollutants. E.g.:

"Outdoor air pollution and cancer: an overview of the current evidence and public health recommendations" (2022)

"Cumulative risk analysis of carcinogenic contaminants in United States
drinking water" (2019)

Any study that chooses to completely ignore this factor in favor of blaming the rising rates of early-onset cancer on 'personal dietary choices' should be tossed in the trash, it's the kind of thing an industrial PR group would generate in an effort to stop clean air/water/food regulations from being implemented.