skysight-inc/HackerNews huggingface dataset:
A missing consideration is that most modern railway is electrified while the airplanes will have to stick with burning fossil fuels for a while.
An absurd exaggeration. Does a hot toddy each night make one a functional alcoholic? Of course not.
Wow, I knew about the problem and was vaguely aware that it had generated some controversy amongst statisticians but I had no idea about the insanely arrogant and obnoxious (not to mention wrong) abuse Marilyn had received from the "intellectual elite".

I have little sympathy for the "ambiguous question" defence. Not only is Marilyn's interpretation grammatically valid, it just wouldn't make sense in the context of the game show for the presenter (who knows where the goats are) to ever open a door to reveal the car and give you the option to switch. The game would be reduced to "does Monty feel like gifting you a car or a goat today".

Furthermore, Marilyn's own explanation of her answer makes it very clear that she interpreted the question as meaning that the presenter will only ever open goat doors. And all the attacks seem to focus on her grasp of the math rather than her interpretation of the problem question.

To be clear, I think it's perfectly reasonable for a person to interpret the problem the other way without thinking too much about it, and casually throw out an incorrect answer. But I would expect an academic to devote at least another 30 seconds of thought to the problem before publicly excoriating a woman known for her high intelligence.
I understand where you are. In my case, 40 years old, happily married with kids, and I still had this lack of purpose. Being completely honest with you, spirituality totally changed my life. I tried lots of paths, stoicism, Buddhism, but Christianism was the answer for me. I really hope you find your way!
do you have HTTP links blocked?
> I STILL cannot crack the purpose and meaning stuff.

Same with 99% of humans! Don't be too hard on yourself.

As for suggestions, I'll echo the others' thoughts about having or adopting kids. Very strong agree.

In addition to that, try to take it all back to the deepest root you can find. Why are humans here? Think about how we were formed by the universe, over time. Why would we have these abilities to think and make and decide? These are the kinds of questions that can lead you to a deeper sense of purpose and meaning. I wrote a book about this, but I always suggest people try to write it out themselves.

Some questions to get you started:
1. Try to explain how humanity fits into the big picture of the universe. Through introspection and examination of the natural world, show how the universe created us.

2. Look at one human’s purpose in the broad landscape of humanity, and try to understand why we find purpose in creating things for the rest of society to enjoy.

3. Look at the order of our universe, our society, and our individual abilities, and try to see how they are naturally linked.
It's frustrating that you explicitly said you don't want kids and 1/4 of the responses are "have kids".

I would suggest (re)watching Groundhog's Day.

After that I would suggest taking up a hobby that involves actual progress. Music, sketching, dance. Something you can really fail at and that isn't practical.

Cooking and running are practical self-care. Some people elevate them to the level of achievement but you aren't experiencing that satisfaction or drive there.

Reading is just media consumption.

Pick something you can't do but that you wish you could do. Try to become non-shitty at it. Rinse and repeat until something clicks.

Set a schedule. Practice the guitar once a week.

It won't necessarily be a purpose. Most people don't find a purpose, they just arrange a useful set of dopamine pumps that satisfies them. That's enough for a primate, especially in recovery.

Our lives don't mean anything. We're stuck in a pyramid scheme where the only "meaning" is to have a kid and hope the kid finds a purpose. The kid has the same problem so they procreate. Ad infinitum, ad absurdum.

Searching for purpose is futile. Searching for satisfaction has a chance.
Clever move.

Thinking about it, Google or Apple should have got in there with Mistral.
Imagine all jobs requiring, not a high school degree, not a bachelors degree, but a PhD
Perhaps, upon initial installation, operating systems should have an option of selecting which operating environment they prefer (e.g. do you want to have all your personal information sent to vendor for customized adds; do you want to have normal OS, or advanced; do you want to use generative AI)?

Personally, my only Windows machine runs Windows 7 Professional 64-bit [turns on once a month]. All my computers sit behind several PiHoles.
Also you're picking between Reward and Bigger Reward. Positive EV no matter your choice so eh don't worry about it too much :)

A nice goat fetches up to $1000 to according to a quick google.
Yes, in two different senses - my fundamental purpose I found in my spiritual faith, and then that works out in my practical day-to-day as creating things, helping people, being in relationship with people.
From your description of a pretty solid life & relationships, I'd echo other responses and say that you may need to find a core philosophy, be it spiritual or otherwise. Humanity has struggled with these questions forever, and I think studying the answers those who have came before will be helpful.
Intentional development and maintenance of other friendships is very important as well - strong social network is both fulfilling and healthy!
I don't need AI to lecture me on morality, or sanitize information for my protection.
naming things is hard. Googling for other things already named this shouldn't be.
That's the correct answer. The wrong answer is 50:50.

The act of retiring leads to the wrong answer, so it does not aid in understanding.
Yeah computation has more layers and sellers, it's not a perfect analogy but good enough I feel
This is why I'm so disappointed with Stripe.

I found the documentation both overly verbose and lacking, so it took me longer than it should have to understand basics like subscription item ids and the 50-100 id types which people have collected into lists. Then there are simple bugs like how the go live button only shows in test mode, with no simple way to copy live mode data back into test environment(s), so developers have to manually export/import stuff that business people set up in their attempt to save time. The most basic features are missing, like a way to copy any object as json from the browser dashboard, forcing us to look down in the logs/events to copy the latest version, often with wildly inconsistent/unpredictable formats.

And Stripe does little to support actual real-world use-cases, for example: subscription events come through webhooks ok, but subscriptions have a state like "active" or "incomplete" (meaning that payment hasn't gone through yet), causing subscriptions to become stateful. Meaning that instead of a user being subscribed (yes/no), the app has to consider additional criteria and edge cases around missing or lapsed payments. And there doesn't appear to be a synchronization mechanism for eventualities like a backend server being down for a day, causing events to be missed. Stripe does a best-effort resend some low number of times, but then the events are lost. It's up to the developer to diff the backend's database with the Stripe subscription list and then sync individual subscriptions manually.

These are all just exactly the kinds of bugs/features I predicted would be there before I used it, which is why they felt like such a slap in the face. I suspect that there are conceptual shortcomings throughout nearly every service provided by Stripe, and I'd be over 50% confident that any ones I predict here would be found upon first use. These are artifacts of favoring agile over waterfall for formal engineering challenges.

Basically what I'm saying is that I consider the Stripe API to be what an MVP payment processing system might have looked like back in the 1990s under older paradigms like SOAP/XML. But nobody has created a wrapper for Stripe yet that works how people expect, more like Venmo/PayPal that maps customer use-cases to CRUD operations.

I thought that maybe Laravel Cashier would do some of the heavy lifting, but it appears to be just a thin wrapper over Stripe, with its own set of oversights.

I know that everyone uses Stripe and apparently loves it, and I applaud its efforts and accomplishments around reducing the friction of payment processing. But I can't help but feel that there is an element of having to drink the kool-aid here. I would still recommend Stripe though, so this rant is directed more at its developers who may not be aware of these issues. Stripe would do well to perform some new user testing like Apple used to do when designing its human interface guidelines, to enumerate the pitfall(s) in each step of Stripe onboarding.
Is there a YouTube API tool? Would love to create a YouTube playlist so that I can watch this on the TV.
I used to work for them, and I agree. It seems confusing from the outside but internally they maintain a pretty consistent system. Many third party partners don't follow this system properly, in my experience.
Isn't that the entire problem though? Agile fails to take into account the realities of corporate politics and human (i.e. manager) psychology?
MiSTerCast 1.00 Release
> anything but Junior developers

Not even junior developers. Only thing it can, and somewhat already has is the students with their assignments. And it is going to spoil a lot of future developers forever. Will all those students with LLM skills be able to enter the market and put generated code everywhere or will that serve as a filter.

I believe first one because before GPTs the entry skill was googling and copy pasting stackoverflow code.
GPT-4 turbo has a context window of 128k tokens, so you can divide every book into a few chunks for initial summarization, then merge the results for the final summary!
And even if you hold Apple stock, that’s no reason to agree with their policies.
At that point you should be using AWS Organizations and OUs.
You would have to change the tax code to provide the incentive not to put constraints on the donation.
> While account IDs, like any identifying information, should be used and shared carefully, they are not considered secret, sensitive, or confidential information.

https://docs.aws.amazon.com/accounts/latest/reference/manage...
Interesting to see this as I recently did a show HN without much success about an F# library also handling raw sql.

I enjoy working with SQL directly, though I understand it has pros and cons. If you need specially crafted queries, it is a must though.

My lib is at https://monazita.gitlab.io/monazita/ and show HN is at https://news.ycombinator.com/item?id=39467742
You haven't used Tridactyl then.
https://github.com/tridactyl/tridactyl
GPT3-176B cost $30 million dollars in compute plus millions in design, preprocessing, and operations. Then, it was able to perform as much better than prior architectures as it does today. You might want to include that in your challenge for competing models.

Let’s rephrase it. If their architecture is superior, and they have $30 million dollars, and similar preparation for training, and similar operational teams during training, then we can see if they can beat the model they’re comparing themselves to. Except, the alternatives don’t have tens of millions of dollars with the best support teams. So, the proof you seek hasn’t had a chance to happen due to severe lack of resources.

Hence, comparisons to GPT2 and small versions of GPT3. Even that might not be fair given the money and teams behind even small GPT3’s. Execution of the project is as critical for success as the model architecture.
Just looked at the pictures and captions, captivating. Worth for the last painting alone.
now there's a multilevel dungeon if I've ever seen one... must be some real neat loot stored at the bottom!
Doubt they use their real information on their AWS accounts.
From my understanding, which may be wrong, you only need the massive compute resources initially to create a compiled vector space LLM - and then that LLM once compiled can be run locally?

This is why anti-CSAM measures policy is possible so compiled-release LLMs can have certain vector spaces removed before release; but apparently people are creating cracks for these types of locks?
> earlier times (and I’m talking about even the 20th century or so), fistfighting was a normal part of life, slaughtering animals for food was something many if not most normal people were accustomed to doing from time to time, and people weren’t as squeamish about this sort of thing.

pull up murder rates for times in the past. not talking 1950s, but like 1850s, or 1650s. cities were often dangerous places, and the countryside could be scary if you weren't a local (and maybe if you were).

examples discussing these topics: https://www.nytimes.com/1994/10/23/us/historical-study-of-ho...

https://www.jstor.org/stable/43774059

from the first link:

> Professor Stone has estimated that the homicide rate in medieval England was on average 10 times that of 20th century England. A study of the university town of Oxford in the 1340's showed an extraordinarily high annual rate of about 110 per 100,000 people. Studies of London in the first half of the 14th century determined a homicide rate of 36 to 52 per 100,000 people per year.
Congrats on sobriety and sharing some of your struggles. I remember when I first had the desire to build a business, I probably spent a month going in circles thinking about all the different problems I was going to need to solve and tools/languages I was going to need to learn. I never really made any progress, so I decided to focus on just the name of the business and then buy the URL. It might have been premature since the business wasn't figured out (I ended up changing it later), but having a name, at least let me mentally move forward with the product and design.

I haven't spent much time thinking about my purpose in life, but I think I would approach it in a similar way. Take small steps (e.g. talk to someone new about what they love in life, rediscover an old hobby) and trust that the steps will build over time into your ultimate goal.
Is that true? I was running Llamas on my laptop a few days ago, and it was giving measurably worse results than ChatGPT. I think it was the uncensored 13B model, but if you got something that's on par with ChatGPT that I can run on my own hardware I'm pretty interested.
Fun fact once flights go above a certain length they get less efficient because all that fuel they are carrying actually requires more fuel to move, which in turn needs to be carried. I don't think it's the energy efficiency that's the issue here. Even if trains are less energy efficient, they can much more easily be powered off renewable sources.
You can export from Authy, not exactly easily for non-technical users though: https://gist.github.com/gboudreau/94bb0c11a6209c82418d01a59d...
"And no, this is not a post where I will say “corporate” agile bad or “scrum-but” bad or any other truth worn thin. On the contrary, I’m talking about the “good” Agile that the cheerful but barely experienced in software development coaches will share with you in a two-day training session. I’m talking about one of the huge pillars of modern agile - Scrum itself.

My biggest problem with Agile is that it has become a cult, full of fanatics, dogmas, sermons, its own mythology, and of course the holy inquisition that fiercely fights heretics. I’m a heretic now. In this post I will say a few anti-Agile things, so you may think I have completely embraced the Dark Side, where all the Evil Managers in their suits sit, and where the looming shade of the Great and Terrible Waterfall instills fear into the hearts of the bravest developers."
He made clear public statements to this effect even during Epic’s lawsuits.
Something to add to the mix:

For those who don't know, capital expenditures that are funded out of a rate case make investor-owned utilities money. If you can get the relevant regulatory body (often a public utility commission) to approve raising rates to cover x dollars of grid resilience projects, the utilities will happily take the money and go forth and implement.

The trick is justifying the spend to said regulators. This is hard with black swan events and regulators that are explicitly tasked with being ratepayer advocates, guarding against the utilities unnecessarily gold-plating things to get a greater rate of return for their investors. It's not like the utilities don't want the money, or the "work" of doing it, or anything like that. Rather, if PG&E went to CPUC and asked for several billion dollars to build a hardened bunker filled with things like transformers that may never be used in the lifetime of the people signing the documents (but the profits realized by the rate of return on the CAPEX will immediately go to investors), they'll likely get laughed out of the room. This issue complicates the discussion about grid resilience, because it can seem to Jeff & Jane Ratepayer (/taxpayer if we're talking national projects) it's all just an excuse to route regular people's money to executives & investors over something that won't happen, the rich get richer, yadda yadda yadda.
Wow. Sounds like it’ll get expensive quick with all the api calls. I hope you make your money back via Amazon.
Ask HN: Need Help with Data Pipeline
Hey guys, I am building a data pipeline to securely extract data from bank statements, credit reports and other financial docs to feed it into a schema for my database so we can work on that data.

Currently I see ChatGPT has the best OCR, but I can't make it to perfectly. Can anyone help. What should I do?
I take classes as a starting point. Then if a course is interesting, it will usually spark ideas that I want to explore further.
On the nuclear side I was looking at a GE BWRX-300 (SMR) because my province is currently looking at building a few of them.

Specs: 300MWe, nominally $1B first-of-a-kind build cost and $675M next-of-a-kind build cost. Runtime between fuel changes is 18-24 months.

--

On the battery side I was looking at the Tesla Megapack 2 XL, since our neighbouring province has a bit of capacity installed.

Specs: 979kW output per pack, 3.9MWh capacity. For 300MW output capacity we need 306 units => $425M. The total capacity from fully-charged to fully-discharged is 1193MWh. Total time from full-charge to full-discharge: 3.9h.

In the middle of winter we have 8h of daylight and 16h of night/twilight. To provide 300MW overnight on a calm day we need 4.02x the storage capacity (16h runtime/3.9h discharge). That gives us 1231 units for a total cost of $1.7B.

--

Yes, the nuclear plant will be more expensive to run (trained staff, security, disposal, etc). On the other hand, the $1.7B cost doesn't include any of the devices that would actually be charging the battery packs either.

We do often get cloudy days and calm days here as well. Saturday, for example, we actually had pretty good wind performance but negligible solar performance: https://twitter.com/SkElectricity/status/1762085119576125812.... A week ago we had both dark and calm: https://twitter.com/SkElectricity/status/1760635567136452664.... These plots are summed across the entire grid in our province, so the commonly stated "well it's never calm everywhere" isn't really valid.
It's almost like hoovering up the internet, feeding it into a computer, and then treating it like it's Deep Thought is a bad idea.
What am I missing? This seems to be a statistical analysis reporting apparent lack of bias rather than a declaration of intent to pay white employees less. The difference seems well within a margin of error.

Disclosure: I am a Microsoft employee. Also, "white".
Surprised nobody in this thread mentioned "How Big Things Get Done". Fantastic read that talks about the challenges of big projects when they don't bring on the right people with existing expertise:

https://www.amazon.com/How-Big-Things-Get-Done/dp/0593239512
Interesting take but not accurate. Many people, like Kamala Harris, didn’t trust the therapy - at least before they were calling the shots.

You may find it useful to group up all the boogymen from your “side” together but it doesn’t make it reality. I, for instance, voted for Obama twice and Hillary and yet still refused to take the shot.

Are you still getting boosters or do you just like to make everything political?
Bd tail: magical real-time streaming of device telemetry
Please, those language models are unable to do basic math and they keep asking "which of X and Y has done more harm".

The same models can't answer correctly which of animal X and Y has more legs!
You're right, any suggestions for a better name are welcome!
> acknowledging all of the costs

Road maintenance is the biggest expense of most local governments in the USA.

Buses obviously take a toll on roads, but the shift to large SUVs is making things worse for the current system of private car ownership.
I have VSCode installed and sometimes I try using it, yet I don't think it will become my main driver anytime soon. First, I couldn't figure out the Leader key modality like in Doom and Spacemacs. I found an extension called VSpaceCode - it ain't great, yet not terrible. There's noticeable latency when I move around the file or type, it's a small annoyance, apparently, all Vim plugins for VSCode suffer from that, meh, but whatever. I still need to learn how to extend it, e.g., I don't know how to add some local leader keybindings.

Having to use mouse all the time is mildly annoying. As a hardcore Vimmer I abhor such workflow.

Opening a file feels wonky, but I probably need to find the right extension or set some settings, not sure. I still can't figure out the simple "find-file" feature where I simply type the filepath, e.g. ~/foo/bar/zap.js and it just gets opened or created.

I miss features of Emacs like Hydra or Transient, I'm not sure if there's anything similar - I suppose there some extension for that.

I don't know if it's even possible to have indirect buffers. In Emacs, I often open a file, then clone the indirect buffer and work with the same file, in two separate buffers as if they are completely unrelated entities. That allows me to hide/collapse certain portions of the file - great for when I need to focus on a specific function, while also looking at the header or the footer portion of the module. I'm not sure how to completely hide some parts of the file in VSCode, even without cloned buffers.

I miss some basic stuff that I got used to. Like for example in Emacs, it's easy to figure out what pressing a key in certain context binds to. There's no `describe-key` functionality in VSCode, you have to open the keyboard shortcuts editor. But if the key is driven by some extension - in my case Vim-emulation, then it gets a bit difficult. I intuitively know that "gd" in Vim's Normal mode is bound to Go-to Definition, but I have no idea where and how this key is set and how to rebind it.

Code navigation and autocompletion in VSCode is nice, that's true, it is also true that sometimes it is hard to figure out all the proper steps to replicate same good navigation in Emacs for a specific language. Yet Emacs still offers unmatched extensibility, and it's easy to extend existing packages. afaik there's no equivalent to hooks or advising functions in VSCode, similar to Emacs.
...What about the Senate?? It regularly rejects bills and sends them back.
It was not my intent to be discouraging towards the project, but rather than a frustration about a consistently misplaced attention from outsiders and science/research community.
If there were a genuine threat of insolvency, they’d solve it today with budget cuts. What are the distinctions as you see them between the ruling class, their political causes, and the state?