skysight-inc/HackerNews huggingface dataset:
Even before LLMs the frameworks for “end-to-end” development of ML models have sucked including the ones I’ve developed ay my employers and the ones I have developed for myself.

What I’m talking about is the need to do

https://scikit-learn.org/stable/model_selection.html

which is not just about training one model but also about evaluating at least one model and usually generating quite a few models with different parameters the latter of which is more essential than ever now that we don’t really do early stopping with neural networks anymore. (Back in the day I built products that could reliably build a useful model in one try with early stopping, which made fine-tuning LLMs so nerve-wracking to me)

For instance the tools I mention above in scikit-learn work great if I am training models that take a few minutes to train on one machine. I have a set of sk-learn models that I train and use every day.

I’ve tried fine-tuning models from huggingface to do the same task, on a good day they perform about as well but take 30 minutes to train instead of 30 seconds. I really ought to be able to run both kinds of models in the same “model selection” framework and pick the best, but boy is it a hassle because it not just about model selection it is about the whole data handling and training process which runs inside the model selection process. For my problems I don’t really like the way huggingface handles data as much as sk-learn/pandas/bumpy and don’t like the model selection facilities in huggingface.

I worked at a place where our model trainer would train foundation models (a few days on a specialized machine, could just as easily have been a swarm of cloud GPU instances) and also train models that incorporated foundation models (a few minutes to train.). We developed our own model selection facilities that worked in the large and at the time I didn’t appreciate the facilities in skl, what we built wasn’t that good and I take 100% of the blame that can attributed in our company to that but the fact that every other framework in the industry sucks (ok, i like SKL for small problems but for large problems it just doesn’t show up)

I’ve built my own code which approximates some of what langchain does, I wouldn’t say it “sucks” the way langchain does but it is very simple, very targeted at one problem, if I tried to grow it up like langchain I’d be swearing at it to.

This discussion really caught my eye because it shows how LLM training is still pre-paradigmatic. I’ve seen this problem and thought I was alone

https://news.ycombinator.com/item?id=37399873

but now I know I am not. Situations like that leave me, as an engineer of practical solutions, feeling really out of control, but academics don’t seem to mind so much because they just need numbers for their conference paper. What gets me is that so many people were seeing this problem and not writing up although it’s pretty deeply disturbing and makes it look like we are training, training and training our models and most of it is wasted work.
Some of it can be achieved by Midnight Commander, maybe?
Dori from SimpleClosure here. Shutting down sucks, excited to help founders and companies with this.
Would love to chat if:

* You or your friend’s company is thinking about or is anywhere in the process of shutting down/dissolving - We’d love to bring you on as a beta customer!

* You’re an investor and have portfolio companies considering winding down

* You already went through this nightmare, I’d love to hear your story and see if there are more ways I can help other founders?
> There are virtually no sugar free foods available in any of the british supermarkets.

A cursory glance at a UK supermarket website shows that statement to be hyperbole.
Sounds like an excellent opportunity for your friend to start his own plumbing company with some other disgruntled plumbers, and offer lower rates too to happy homeowners.
The word on the street is that Apple will do it only in EU and will be serious about enforcing it. According to the rumours, Apple will check against location and verified EU iCloud account before allowing side loading.
... in order to try and prove the tech is useless.

I don't need to prove anything that the marketplace hasn't already.

The burden of proof is on anyone proposing a blockchain solution --- which I assumed is what you were looking to address.
Of all the horrible things go on with privacy these days, this is the one I hate the most. I’m a “car guy”, but not the sort that obsesses over old cars (although I do love 60s and 80s cars). I like new tech, I like the advances in engineering we’ve made in new vehicles, I like EVs even.

Nonetheless I’ve been in the market for a new car for months and haven’t bought because it’s hard to find any cars that meet my requirements (after all most companies primarily make trucks and shitty crossovers, not even cars). The two things that consistently hold me back are either things like this (crazy telemetry / touchscreens everywhere / half-ass safety tech) or insane dealer markups. I’ve pretty much figured out the new Toyota GR Corolla is the perfect car for my needs, but you can’t find them anywhere without a $25K+ dealer markup and many dealers won’t sell them to out of state residents.

It’s truly a crazy time in the new car markets and the used market isn’t really any better.
This is interesting. I did not log into it for ages but sure still get the alerts for my existing trackers. That's why I assumed that they are still around.
Population growth was exponential too, until it stopped being exponential. Real world doesn't always follow our well-behaved mathematical functions.
The average US diet is a direct result of lobbying and government action based on such lobbying, as it is visible if you go almost anywhere else, including poorer countries like the US neighbors in Latin America.
Eight is excessive. 2-4 is probably the sweeter spot. I was just thinking if you’re going to the trouble of laying out a pcie slot, lay out a full 16 lanes and an expander board will slot 4-8 drives optionally.
Having spent some time using both in a professional context, I would actually choose Java over Scala. And I say that as someone who cut their teeth on functional programming and still tends to prefer it over OOP.

The problem with Scala is that good, maintainable code is defined more by how many language features you have the discipline to avoid using than it is by how many you do. And that makes it more difficult to keep a large Scala codebase maintainable on a team with varying levels of experience. Freely mixing ad-hoc and subtype polymorphism (that is, type classes and subclasses), for example, is a very short, very slippery slope to a situation where the best way to figure out how the code works is to already know how the code works.
Co-pilot for the data stack. Cool!
I wish I had any idea what you were talking about lol it sounds cool
My buddy and I recently went down a rabbit hole researching this after "processed foods" started to be the topic everyone was talking about.

It really is nonsense when people try to define it scientifically.

This is the closest to anything we found that makes sense https://en.wikipedia.org/wiki/Food_processing#Processing_lev... but it's kind of separate from the popular idea of processed foods

Here's a Nature article discussing the problems:
https://www.nature.com/articles/s41430-022-01099-1
I think you are correct about the article. But I still think a lot of cars on the EU market collects (top much) information. But thats just a guess for sure
Wage growth has not matched productivity growth for decades.
I used to work for a state motor vehicle agency.

Federal law requires the manufacturers get your up to date mail address for recall purposes.

Legislators make sure that the agencies sell that data (this is the source of those "we've been trying to reach you about your vehicle's warranty" letters/calls). Sometimes they interfere to ensure that their buddies/lobbyists don't pay for it.
That was almost two years ago and would have been for legal residents only, and only municipal elections.
I haven't used a Pi for this stuff but you could check back into the old Andre Lamothe books from the old days.
I had to look it up: CPAP = continuous positive airway pressure; to treat sleep apnea disorder

I do have sleep apnea disorder but probably a mild one as I don't feel exhausted at all. Reading your comment sparked the idea that it might be a good idea to verify the severity. If there will be any CPAP machine involved I will for sure think of its privacy impact.
So I'm on team wired as well, but honestly it does seem like the "change the batteries lose the info" thing has become far less common.
Eliminate trust.

The thing must be functional and operational by its own volition. No clouds, no hosts, no servers controlled by 3rd parties that control anything.

You do this by: 1) encryption. Make all data useless. 2) standardization. IoT devices must be compatible with multiple hosts, one being one you can install and run yourself. 3) open source (source available)

Companies can still sell their goods by: 1) offering the "thing" that must be bought. 2) offering the software or point to the software, maybe with added bells and whistles (a source-available extension, audited by FCC plus 2 other parties etc).

Control must be localized. In the app of the user etc. No round trips to any clouds.
Recently watched the Imitation Game as prep for a visit this weekend to the Museum of Computing located at Bletchley Park: https://www.tnmoc.org/
If the rumors are true, GPT-4 is a Sparse Mixture of Experts, not an ensemble.
>> This is why I've never used or understood the value of the "downgrade" feature in some database migration tools

It's technically a roll forward, while to most users it's more nature to say rollback/revert
Quebec had a similar problem recently: https://www.cbc.ca/news/canada/montreal/saaq-portal-drivers-...

Personally I think governments need to rethink "modernization" - it's just shifting jobs to bureaucrats and funneling money to IBM et al without any improvement for citizens. Whatever they did for drivers licenses in the 80s would be better for everybody except entrenched parasitic interests.
My shot >> Illa dixit vale multis temporibus

(*) if you drop the pronoun you can even sing the Latin lyrics on the same division. :)

In colloquial pt_BR that would be 'Ela disse adeus muitas vezes [antes]'
The most natural translation in modern Portuguese is "Ela disse adeus vezes demais antes."
They do! My friend worked with them and it was surprisingly affordable. They price based on various factors around the scale of the company
In the long term the big commercial models could be doomed. The trouble with GPT-4 is that its knowledge base gets more out of date every day since it has been trained. The large number of coefficients and extensive training process is not a competitive advantage, it is a disadvantage.
>will automatically flag and forward messages to Meta

Citation please. Specially on automatically..
Definitely - that’s why I described it as drivers seeking excitement since it rarely is a win from a logical standpoint but there’s so much culture around driving fast.
Lots of people don't want universal health care for reasons that are not incredible. I've had employer provided insurance I'm happy with ever since I left my student insurance plan over 25 years ago and have few complaints about it. I'd prefer not to risk transitioning to a universal system that might provide worse care than what I've always had. Kaiser in CA for example is the worst insurance I've had - would not want to return to anything like that where there is a single network of providers. That was my mistake though - I didn't have to choose Kaiser, I had other options.
I keep the same set of configuration on Linuxes and Windows. Works best for muscle memory.
I'm curious about the application and implication of using generative model for comparative analysis. Wherein, if the results are incorrect or a have a slight error in a map, can lead to incorrect conclusion and impact on policy.
This observation is not centered on the Satlas projects because medical image analysis is also out there (but may be the FDA can drive some regulation).
Broader question, how would we have to think about generative modeling for applications that are more then entertainment and cannot be corrected/ verified
by a person (like the user in case of ChatGPT)
Detecting whether a tree-like data structure contains a cycle
True. Including market cap in the definition is another oddity in this - why not just look at the size of the active user base?
Literally. What is called "profit" in a private industry is what would be called "waste" in a public service. It's literally money that runs through the system and accumulates rather than being used. Ironically when politicians want to run a public service more "like a business", they will try to squeeze the budget to cut costs to in turn justify further cuts until the service fails to do what it was originally meant to do and has to be replaced by a for-profit industry that generates an even larger overhead at even more cost to society once you factor in the fees, subsidies and other factors.
I agree that some claims about e2e are misleading. That said, you could interpret "mathematically impossible" very charitably as risk assessment math. It's mathematically impossible to improve investigability while also improving resistance to spying by adversaries. Their relationship must be inverse. I agree that most people would interpret "math" as cryptography, and that it's better to make a clearer distinction between cryptography and risk assessment maths.

However this goes both ways. People demanding a solution think that you could make something investigable while keeping it completely airtight to adversaries or abuse. There is no escaping the fact that this is mathematically impossible in terms of how risk works. You can compromise security in favor of investigability, or you can improve security at the cost of investigability. And it's also important for the lawmakers to understand that each compromise is not gradual. It's drastic. If you went from 1 party having a key, to 2 parties, you've probably doubled vulnerability surface. If it's 3 parties, and one of those parties is an organization with lots of employees, you've probably exponentially increased vulnerability surface by orders of magnitude. This math does apply here.
Immediately stopping all greenhouse gas emissions would kill a lot of people quickly by breaking supply and production chains for pretty much everything. So that is not an option.
This article doesn't go into any benefits to the driver/user, if available. With all the cameras and microphones in cars these days they can at least send the insurance companies all the data when an accident occurred. Were you on the phone? Driving the speed limit? Have your seat belt on? Braking hard to avoid (or cause) an accident? Heck, give me a monthly riding report with information such as how fast I accelerate, how hard I brake, how often I speed, and stuff like that. Then provide tips on how to improve my driving. At least that would be useful.
Are you saying that larger sample sizes lead to greater variance in results? Because I don’t think statistics usually works that way.
I guessed as much, but I wasn't able to confirm. Thanks for the search.
It is indeed changing in countries like China for a variety of reasons.

Some of it being the pressure and pace of modern life. Some of it being western foods being perceived as a "luxury" item and status symbol (e.g. Starbucks). Some of it being changes in economics.
That's exactly so. Many of the groups know each other, have their private comm channels, and select insiders that release things out to the broader public. There's obviously drama around people leaking releases, stealing cracks, etc. Fun little sub-culture!
> Do these people even know what they are talking about?

Yes, this is actually a good summary, as good as a layman can be expected to produce. Just because they don't use the right jargon doesn't mean they are stupid.

We have thousands of examples of big tech firms breaking interoperability on purpose, and it is in their interest to do so.
I know the intentions are positive here, but I can't help feeling like this is going to have unintended consequences that make services worse for the majority of us who do not live in the EU, like GDPR did.

We have a regulatory body that doesn't prioritize standardizing on a single type of electrical plug now driving digital standards for companies that operate globally.
This seems incredibly naive. Addiction affects peoples ability to make rational choices.
Agreed, It's definitely not a conspiracy that US federal regulatory authorities have gotten more lax, beuracratic and ineffective over the decades. One can still generally subscribe to a world view while being critical of its shortcomings.
I don't buy it. In any common usdage "6 liter jug" means a jug capable of holding 6 liters, not with a volume of 6 liters including the walls.
That’s quite a big assumption to think that it would be clearly labeled, and also that it would have a dedicated fuse. It’s not like that would be such a huge power draw that it needs its own fuse. Pulling the fuse would likely cause the whole infotainment system to go down.
I arguably got where I am today because of a job I had no commercial experience in before I started, so I understand where you're coming from - but my point is that this type of lucky break is generally going to work out when they are already willing/planning to hire a junior anyway.
It's sometimes done to game battery benchmarks, thus benefiting the manufacturer. Not sure how much of a thing it is these days, but there was a time when many Android OEMs shipped the phones in a basically broken state in a bid to do well in battery benchmarks; in particular, push notifications often wouldn't work reliably or at all in default configuration.

But yeah, I don't think the DMA's particularly relevant here.
This is kind of an urban legend, do you think the multi millions servers from Google, Amazon etc... have those performance issues?
Routers are decently large , generally have enclosures, and are meant to be placed in a reasonably accesible position for those who should have access to them while at the same time out of sight for those unauthorized, which makes putting a sticker on it, keeping it there, and having the right people read it when needed is trivial.

Some IoT devices could be handled the same way, but there are plenty of reasonable IoT applications where a password written on the device is impractical or a security risk.
Interesting list. The only European companies I recognize are car companies; Volkswagen, Fiat Chrysler, and Mercedes-Benz. The rest are all energy or mining companies, with the exception of Schwarz Gruppe which is apparently a retail chain? It's also surprising how many of the American companies are healthcare-related, and how the relative ordering changes to favor tech and oil companies when you sort by profit instead of revenue.
Might depend on the wording of the law and how that system is tied into the rest of the car. For example in the states, it is illegal to tamper with any part of the emissions control system on your car. This is mostly about making sure emissions testing via OBD II can’t be gamed, but it also would target modifications like “rolling coal” or turbos and superchargers that allow user controlled fuel mapping. But in the crossfire it catches completely reasonable reasons to modify your emissions system like a flex fuel upgrade, or replacing the computer of your old car with an aftermarket one because the engine immobilizer unit died and they’re paired together and OEM computers and immobilizer kits are either too expensive or not obtainable anymore.

Laws against tampering with vehicle safety devices would easily have a similar effect on your built in phone home systems.
I believe neither MOND nor Condensed Dark Matter are theories exactly, so much as they are schemata for classes of theories. Both are struggling to produce a verified theory that accounts for all observations, and while the latter is much more widely regarded as likely being correct, MOND has not been conclusively falsified to everyone's satisfaction. I would guess that there are, at least in principle, MOND theories which work for galaxy clusters but have residual discrepancies when applied to galaxies.

If this is so, then a multi-choice question which conflates one particular MOND theory for MOND itself, and which depends on the specifics of that particular theory for selecting the 'correct' answer, is problematic: for one thing, it may make selecting the 'correct' answer more difficult for a student who has specific knowledge about the topic. This is just one of several problems with multi-choice questions, though, fortunately, it does not seem to have any bearing on the very interesting phenomenon you have discovered.
I hung and agreed on every word but specifically;

> Empathy becomes just another service you can summon with your phone, so why bother practicing it?

Yikes. So true.
Just like when I burn my pancakes. I so wish I could CTRL+Z IRL. Those files are gone. Adios. Please don't tell me you use "Recycle Bin".
Why just in the EU?! I know.. because of strict regulations and fear of billions in fines.

But.. what if Microsoft plays fair and just ditches this aggressive behavior and shows some respect to its users who have already paid for their Windows license and let them use whatever software they want.

I use Edge as my default browser in Windows and just a few days ago wanted to test something related to web in Chrome. I have chrome installed but didn’t open it in months now.. but, guess what? The moment I clicked the chrome icon, a notification popped up saying something like: “Use edge, a fast, secure.. a bla bla bla browser..”. I was literally shocked by how far can MS go to promote its own products even if you always use them as your main tools.
Direct costs maybe but how much of the staff cost is staff required to make the site run?
At least from my view as a young millennial, drinking culture among gen x and younger boomers is enormous. Wouldn't be surprised if that plays a role here.
Yes, is there a problem with what I’ve articulated? Have you heard of Composition Fallacy or Simpson’s Paradox?
This is why I don't donate.
I often wonder when it it would cease to be in the interest of US tech firms to serve the EU market. Meta choosing not launch Threads in the EU seems like a bellwether.

Everyone seems to assume that it won't happen.. that public companies can't ignore the EU market without shareholder revolt, but if the EU's vision of tech is more restrictive than the rest of the world's, it might just be the way that things go.
Find a private broker to locate and acquire a car for you
There's a very practical reason why waterfall fails in most software development projects: in the waterfall model you do project planning and budgeting based on the specifications you write. I'm not arguing against the specifications other than to say that in a lot of cases in modern software development you haven't got time to write all of those specs to the proper level of detail. But then you go on to do a critical path analysis. That requires assigning people to tasks and having detailed task descriptions at a very early stage of the project. The odds of that being right are very slim. It can tell you at best whether your project is plausible. Again I have no problem with that. But once you start managing the project, the agile approach of assigning people to tasks in iteration planning meetings works a lot better than trying to stick to your painstakingly created critical path analysis. You also don't need highly detailed task descriptions and implementation plans until you get to your iteration planning meetings. Then they are crucial. But putting off that work until you need it saves a lot of time at project start.
TikTok trackers aren't built into my phone's operating system.