skysight-inc/HackerNews huggingface dataset:
The problem with most chunking schemes I’ve seen is they’re naive. They don’t care about content; only token count. That’s fine, but what would be best is to chunk by topic.

I’m currently trying to implement chunking by topic using an LLM. It’s much slower, but I hope it will be a huge win in retrieval accuracy. First step is to extract topics from the document by asking the LLM to identify all topics, and then split by sentences and feed each sentence to the LLM to identify the topic. I’m hoping the result will be the original text, split by topics. From there, they can be further chunked if needed. Of course, it could be done by just one shot asking the LLM to summarize each topic in the document, but the more the LLM is relied on to write, the more distortion is introduced. Retaining the original text is the goal and the LLM should just be used for decision making.

Here is the crate I’m working out of. The chunking hasn’t been pushed, but you can see the decision making workflows.
https://github.com/ShelbyJenkins/llm_client
Intense Exercise Lowers Activity, Body Temp, Tied to Weight Gain
Turn-based games are more complex because having time to make your moves allows you to consider much more than you could in real time.
> patterns will eventually repeat

I know that theory, but isn't this a non sequitur?

let's image an infinite universe with only two possible patterns. isn't it perfectly conceivable that pattern 1 occurs only once and pattern 2 infinitely often?

edit: ok, "patterns will eventually repeat" is obviously true, what I meant is that "ALL patterns will eventually repeat" does not necessarily follow - which is implicit in the parallel universes thought experiment.
Successfully Starting a Career in Quant Research (2018)
oh my point was that somebody has to strike the fear of god in them first before they start trusting the llm blindly. I know the llm can fake this kind of thing, especially if you put a prompt that forces "as an LLM, I'm probably going to shoot you in the foot randomly", but I'm sure they'll get used to ignoring it.
In theory. In practice, context size degrades performance.
If it's really just inefficiency, wouldn't a mutation that removes some of the surplus genome bring an evolutionary advantage? Those mutations are probably rare and the advantage miniscule, but anything adds up over a long enough timeframe
The number of permissions of a deck of cards is 2^225 according to the article. Permissions grow quite quick
Do you know much about Windy, and whether they have any ties to selling user location data?

All the plots and features seemed nice so I paid for a year of subscription (after Dark Sky was discontinued ugh), but if they do that I’ll just stick to the default apple Weather app.
Web Performance Books to Read
Odd. I actually use FF mobile myself and it appears fine, but maybe it's my resolution? I do see that the layout of the metadata row on the homepage is a bit funky and the image in the post is cut off. I definitely need to clean that up.

Would you be able to take a screenshot of what you're seeing?

I'll add disabling of the fixed viewport to my TODO list. No real reason to disable it -- I think it was a leftover from the original mobile design from ~15 years ago.
> The US opposed Google's motion to strike the jury demand in a filing last week, arguing that "the check it delivered did not actually compensate the United States for the full extent of its claimed damages" and that "the unilateral offer of payment was improperly premised on Google's insistence that such payment 'not be construed' as an admission of damages."
> The government's damages expert calculated damages that were "much higher" than the amount cited by Google, the US filing said. In last week's filing, the higher damages amount sought by the government was redacted.
I think you are right! That is an excelent find!
Oh for crying out loud! WTF???

I think someone spilled idiot juice in the water.
Read the original comment I replied to. It's relevant because they mentioned Windows, macOS, and Linux but swear not to use Windows. And people often blindly bash Windows and Microsoft when macOS and Apple are 10x worse, which was my most recent point.
I have a laptop with an MXM slot and video card, keeping an eye on this, I might be able to upgrade it sometime soon!
For what it’s worth, Civ 6 works well on my M3 MBP
Shrink the Economy, Save the World?
Bigger relative to what?
… yes to the 2^k only because if not met, the performance devolves to a linear search. By themselves, k-d trees can handle any number of records.
Furiosa: Blink and you'll miss a solarpunk alternative to series' usual dystopia
original title:

Furiosa: A Mad Max Saga – blink and you’ll miss a solarpunk alternative to series’ usual dystopia
> Do you really believe that fundamental research would get more investment if it were left solely to market forces?

Lots of monied people donate to scientific causes:

> Since its founding in 1994 by Jim and Marilyn Simons, the foundation has been a champion of basic science through grant funding, support for research and public engagement. We believe in asking big questions and providing sustained support to researchers working to unravel the mysteries of the universe.

* https://www.simonsfoundation.org/about/

> Perimeter Institute for Theoretical Physics (PI, Perimeter, PITP) is an independent research centre in foundational theoretical physics located in Waterloo, Ontario, Canada. It was founded in 1999.[2] The institute's founding and major benefactor is Canadian entrepreneur and philanthropist Mike Lazaridis.[3]

* https://en.wikipedia.org/wiki/Perimeter_Institute_for_Theore...

Would Musk handing over $17B for this instead of $42B for Twitter perhaps been better for humanity?
See https://en.wikipedia.org/wiki/Neural_cryptography#Applicatio...

> One example of a public-key protocol is given by Khalil Shihab. He describes the decryption scheme and the public key creation that are based on a backpropagation neural network.

Which leads to this paper by Khalil Shihab (2006)

https://web.archive.org/web/20070712012959/http://www.scipub...

> Abstract: In this paper, an efficient and scalable technique for computer network security is presented.
On one hand, the decryption scheme and the public key creation used in this work are based on a
multi-layer neural network that is trained by backpropagation learning algorithm. On the other hand,
the encryption scheme and the private key creation process are based on Boolean algebra. This is a
new potential source for public key cryptographic schemes which are not based on number theoretic
functions and have small time and memory complexities. This paper along with test results show that
the possibility of guessing keys is extremely weaker than using the Data Encryption Standard method
(DES), which is a widely-used method of data encryption. The presented results are obtained through
the use of MATLAB 6.5.1 software.
I just want to apologize for part of the tone of my response.

I don't think we're gonna get anywhere here otherwise.

[EDIT: I'll take 50% of the blame for this going sideways.]
Neural Similarity and Synchrony Among Friends
it's from Socrates, as channelled by Plato.
No. We have a complete fucking disaster on our hands.
> They don’t care about content; only token count. That’s fine, but what would be best is to chunk by topic.

I’ve had a lot of success with chunking documents by subtitle. Works especially well for web published documents because each section tends to be fairly short.
EU Plans Major Expansion of Mass Surveillance
If you're a small outfit you can't keep someone like that around. You need to part ways. You can't rescue this particular situation. You're screwing the guy/gal you hired, too - they're probably under a ton of stress, and high stress over the long term is not good for anyone. You should also recognize that this stress is not entirely their fault - it was _you_ who hired them, so you share some responsibility for this hiring failure. You may be tempted to demote, but I have not seen this actually work out in practice. I'd let that person go.
Spoiler warning, although this is only in the first several minutes of the film.

I caught it, and I'd love to find out so much more about this Solar Punk world. One key thing is what happened to it, when Furiousa tried to return and found only a few refugees left.
phoenix liveview.
> oh my point was that somebody has to strike the fear of god in them first before they start trusting the llm blindly.

We agree on that :-)
How old of a system? Do you feel it’s the implementation, the design, or the concept itself that went wrong? Is your system a good fit?

(No stake in this one way or another, just curious.)
Relative to what it was before. It has an intrinsic size. Think of it in terms of matter density if you find it more comfortable. The density simply goes down over time; distandes between galaxies increase.
Here is a trivial shuffle algorithm that is completely unbiased and only requires an unbiased coin (or random number generator giving bits):

1. Randomly assign each element to list A or list B.
2. Recursively shuffle lists A and B.
3. Concatenate lists A and B.

To prove it's correct, note that assigning a random real number to each element and sorting based on that number is an unbiased shuffle. Then we note the above does in fact do that by considering the fractional base-2 expansion of the random numbers, and noting the above is in fact a base-2 radix sort of these numbers. We can sort these random real numbers even though they have an infinite amount of random bits, as we can stop expanding the digits when the prefix of digits is unique (which corresponds to the event that a list is down to a single element).

I call the above algorithm RadixShuffle. You can do it in base-2, but also in other bases. For base-2 you can make it in-place similar to how the partition for Quicksort is implemented in-place, for other bases you either have to do it out-of-place or in two passes (the first pass only counting how many elements go in each bucket to compute offsets).

The above can be combined with a fallback algorithm for small N such as Fisher-Yates. I believe even though the above is N log N it can be faster than Fisher-Yates for larger N because it is exceptionally cache-efficient as well as RNG-efficient whereas Fisher-Yates requires a call to the RNG and invokes an expected cache miss for each element.

---

Another fun fact: you can turn any biased memoryless coin into an unbiased one with a simple trick. Throw the coin twice, if it gives HH or TT you throw away the toss, if it's HT or TH you use the first toss as your unbiased coin.

This works because if p is the probability that heads comes up we have:

HH: p^2
HT: p(1-p)
TH: (1-p)p
TT: (1-p)^2

Naturally, p(1-p) and (1-p)p are equiprobable, thus if we reject the other outcomes we have distilled an unbiased coin out of our biased coin.
Jim Butterfield Commodore 64

https://m.youtube.com/watch?v=J9WnHuGjZ38
I haven’t, but one reason to switch that I’ve heard is the ability to run OCI containers natively.
Civ 2 was the last one I played (after that... I became a dad), but you could station a phalanx in frigid arctic and it will stay put, for two thousand years, being a phalanx. Battle realism was not really something the series cared about.
Ask HN: Async Python Adoption?
Are there any studies, large-scale polls, or anything about async coding adoption in Python?

I wonder how widely the community accepts it, how widespread its usage is, and what the general sentiment is towards it.
Less than 5 years. Vanity project. Built and maintained by astronaut architects. Entirely unnecessary. Poorly implemented down to the level of wire contracts being inconsistent. Overheads are insane both from engineering and operational POV.
The infamous Potato Salad Kickstarter fulfills its final goal (2016)
The geothermal project in remote areas in Kenya to mine bitcoin to fund conservation efforts and provide electricity for the small local population. This is easily a good humanitarian idea and can foster local economy.

The El Salvador (with geothermal power development) program could also be a nice way to fund government and boost local economies.

Using excess power generated by renewables can help fund the development the renewable power sources. In slack power times use the power for mining. It is done already in other industries.

Remember that the mining does not just generate bitcoins but is a way to pay people to maintain the bitcoin network. Instead of banks handling the transaction miners do. Having a functioning monetary system is generally a good thing. Not that we do not have this already but the crypto currency system offer an alternative. Concentrating on the mining is sort of missing the point of crypto currency.

I would not want to argue that all the project are meeting the stated goals. I am sure that lots of the real goals are for some to make a mint. There is plenty of corruption all around and this is not unique to crypto currency. It is not going to solve all the worlds problems but it has its positive points also.

Edit: Will also add that (just like more traditional banking) there are lots of people doing real work to make these things happen.
> Companies like Google have had access to our full email, search, location, photo roll, video viewing, docs, etc history for 10+ years.

speak for yourself

> Hell, I have multiple Google Home devices that are always on and listening

yeah, doesnt mean everyone has
iCloud != the new Passwords app, which is what we’re talking about.

Do you also think the Messages app is cross platform because there’s an iCloud app for Windows?
I hope whoever penned this quote was proud of themselves, it still carries a provocative punch after 2000 years:

‘Would you in your refusal to revoke this law’, the question was put to the Senate, ‘allow the trappings of your own horse to be more splendid than the dress of your wife?’
Shape Dividers
When I clicked that link I saw a flash of unstyled content, so that's immediately worse than HTML.

My point was that if you count the time spent looking for the perfect renderer, HTML is faster and easier to write than Markdown unless you're writing a book. You just added another option someone has to spend time evaluating to the pile.
> Bureaucracy happens because

I'm not sure that's a good description, either. Each bureaucracy has an "owner" - the person (or group of people) who decides how it should work. Bureaucracies that have an owner are highly functional, and we don't normally notice them. We notice, however, abandoned bureaucracies, where nobody even knows why and how this particular bureaucracy was designed and can't change it in response to the changing environment. That's where bureaucratic organizations start resembling kind of intelligent (yet stupid) organisms whose goals are not necessarily aligned with ours, but we have to live in the same world with them.

It's a refreshing thought to think about organisations as living creatures with their own "brain" and agenda. We are kinda so used to living among them. Perhaps living alongside AGI systems would not be drastically different from this experience.
Yes, it’s a great tool for integration. We have a product suite and it’s our chosen way to connect products.
Very recently, we were complete morons.

See page 3:

https://research-repository.griffith.edu.au/server/api/core/...
"I'm sorry, I didn't understand much of that. Are you saying you can commit to finishing the feature on a shorter timeframe than you originally asked for? Would it help if we forgo writing tests?"
I was the lead developer on one for an insurance company a few years back, and it’s still in active use. Insurance is a heavily regulated domain, where an audit trail is more important than performance. There was a natural pattern for it to follow, as we were mapping a stable industry standard.

I also tried doing it in a property setting, where profit margins were tight. The effort needed wasn’t worth the cost, and clients didn’t really care about the value proposition anyway. We pretty much replaced the whole layer with a more traditional crud system.
i pay twitter $16/month so i can scroll art without ads.

instantly subbed to cara.

hopefully they find a way to make it work without plastering ads everywhere and selling out to investors.

what an exciting story to watch develop!

viva la indie renaissance…
I enjoyed the Garbage Collector algorithm he chose: "I have 256GB RAM in my machine."
I find it funny how YouTube Keeps cracking down on gun content, but just watch one gun video and your recommendations will be full of gun content.
Density has the same issue. Density can only be measured against a baseline established outside of the medium being measured.
> Microsoft is calling them with updates on why “e-mail” isn’t working. So I actually think Microsoft is great from that side of things.

maybe they should have used their skills to have it continously work rather than put up a huge organisational structure ensuring they will give you hourly updates on WHY they screwed up :) but I get it, the government-customers do not care AT ALL about the services to the citizens, rather their objective is cover-my-ass and to provide explanations up the chain
Or maybe the simple growth plan allowed it to accumulate lots of cruft that’s basically doing nothing
It's casual crossword solving vs competing at Jeopardy. Civ games last a very long time (depends, but e.g. 10 hours) and are extremely slow paced, which plenty of people enjoy. Games like Age of Empires punish you for daydreaming for mere seconds during a 30 min match.
The best thing about being a theoretical scientist is nobody can refute your claims.
Claude's Character
London–Calcutta Bus Service
This game is a lot of fun. Highly recommended if you like destructible environments and puzzle solving.
Not sure, I may have mentioned something about iOS OCR in general (not the app, which I’ve never discussed publicly before now).
Physicists Propose a Doppler Telegraph Wave-Based Theory of Heat Transport
Adding those imperfections to the video in post allows your brain to fill in the blanks and make it look more realistic. If it were a 4K video the CGI would be a lot more noticeable.

I think the retro look will probably stay as I feel it's part of the aesthetic.
But maybe in the future we'll have backrooms-style videos of the current times, and then I imagine the retro/vintage aesthetic will go away.
Yes! Now we can see how the NYT … serves their pages? … retrieves their records from a database? … uhm … centers their divs?
Autodafe 1.0 Released for Freeing Projects of Autotools
I'd never encountered the term "presentist" before, and at first blush it sounded like some kind of hipster slang.
Turns out it's been a word for at least a century, and I have to admit the definition encapsulates a worthwhile concept. Not to be confused with "presenteeism".

The commenter could also have said: "Let's remember we're viewing this through the looking glass of today's values."
Finally sth to monitor our politicians and every director/leads at state agencies or state owned companies. I always wanted to have that for my emoloyees that I pay +50% of my sallary to.
There's a few things going on -

(Also, I am indeed American but have lived in Europe for the last 11 years. I moved from Ireland to the Netherlands a year ago so our kids could have more independence, though even here is imperfect).

For the US - and actually a good deal of Europe too - terrible urban and street (stroad, rather) design makes it dangerous and impractical to bike as a child. Having 3 inches of paint as the only protection against a Dodge Ram doign 50 mph isn't ideal.

Also, things are spread farther out compared to older city designs, and there are fewer kids, so within a 5 minute bike ride you'll have fewer friends.

And - this is something my mom tells me at least - two income households becoming the norm means you don't have that safety net of moms (it was almost always moms) with an eye out the window that you could run to in case somebody was badly hurt.
But if you pay them you can be in their private discord...
From reading ‘I Claudius’ I additionally remember Livia and Messalina.

[Edit] oh, also Calpurnia, and Incontinetia Buttocks
You’re basically reinventing embeddings. Using an LLM for this is overkill since capturing the meaning of a sentence can be done with a model 1000x smaller.

I have a chunking library that does something similar to this, and there’s actually quite a few different libraries that have implemented some variant of “semantic chunking”.

[1] https://github.com/Filimoa/open-parse
> Claude 3 was the first model where we added "character training" to our alignment finetuning process: the part of training that occurs after initial model training, and the part that turns it from a predictive text model into an AI assistant. The goal of character training is to make Claude begin to have more nuanced, richer traits like curiosity, open-mindedness, and thoughtfulness.

What I found particularly interesting is how they implemented this using primarily synthetic data:

> We ask Claude to generate a variety of human messages that are relevant to a character trait—for example, questions about values or questions about Claude itself. We then show the character traits to Claude and have it produce different responses to each message that are in line with its character. Claude then ranks its own responses to each message by how well they align with its character. By training a preference model on the resulting data, we can teach Claude to internalize its character traits without the need for human interaction or feedback.
It depends on the neighbourhood but at least when I was a kid in Stockton, California everyone in my school was driven, and that was the 90's.
Indeed, but walkable neighbourhoods are hard to come by. Even Europe has plenty of car-focused design.
Unsure if this is clear so I'll say it: Those are not real time OSs
Not only don't I see anything objectional, I can't even figure out what bits you find objectionable.

Experts talking to each other? Anyone talking to, or being funded by, Fauci? People changing their opinion after digging into the evidence? People disagreeing with your interpretation of the facts?
I’m mostly in Apple’s sphere of influence, but I still need my password manager to work from other people’s Android devices. So no thanks Apple, I’ll stick with Bitwarden.
"The generalized telegraph equation with moving harmonic source: Solvability using the integral decomposition technique and wave aspects" (2024)
https://www.sciencedirect.com/science/article/pii/S001793102... :

> Highlights: [...] It is shown that the Cattaneo-Vernotte equation may be used to describe the wave properties of the heat transport.
I always have my laptop sitting raised above a surface if I also have a drink on that surface. I figure it reduces the chances of a spill getting into the laptop.

Macbook Pros more resistant to fluids than non-pro hardware?
For you, maybe. For others, having thing that does what this other thing did, with no regard to cost, is a fun adventure, in and of itself.
AI Systems Are Learning to Lie and Deceive, Scientists Find
Wired for Story
Does this describe how solar thermal infrared heat works between the sun and the earth, or only after unitarily transforming optics like mirrors and concentrators?
Ah. In that case, I'm not sure what the difference is. Both Rosetta 2, and WoW are translating blocks of code to native, not doing a CPU emulation...

I'm wondering if Apple actually has some sort of license to do the translation. Rosetta 2 isn't installed by default. On the PS3, Sony had a pile of media codecs available, and you had to enable each one manually to generate a license key... which I'm sure was to avoid paying for codecs that people aren't using. Rosetta requiring an installation could just be space saving, or could be a sign they're paying a license per install, and avoiding the cost when it's not needed.
Real-world mileage standard for new vehicles rising to 38 mpg in 2031
Thanks, will try it and let you know!