skysight-inc/HackerNews huggingface dataset:
Show HN: The Canada census data in a SQLite file; advice appreciated
This is niche, I'll admit.

I needed to look through the latest census data, but it was exported as multiple multi-gigabyte bespoke latin1-encoded CSV files. Pandas, Polars, and SQLite's CSV import tool weren't much help, so I shelved the project until recently, when I started taking a SQLite course online.

I picked it up again, normalized the data, and now there's a database that can be queried through a SQL view that matches the headings in the original CSVs. I'm proud of the script I created to export the data, as well as automatically compress the artifact, make the diagrams and checksums, etc.

This is my first time building up a big database, does my schema seem sane? I've been considering switching the counts from REALs to TEXT, since then SQLite's decimal extension can do exact calculations, but considering there's only one or two places after the decimal points in the data, I'm not sure if it's worth it space-wise.
People who indent like that should be in jail.

I'm following a junior who is working on a project where everything, including braces, is indented like that.

Some lines overflow on a 2k screen.

So stupid... And it requires much more effort than just indenting logically depending on the depth of the current block. You have to wonder why people do this to themselves and to their colleagues.
Since it's so easy to invent with AI there's no need for patents or copyrights anymore. The money isn't the idea anymore, it's the product.
How does Google notebooklm scrape websites?
What tools are they using?
You could do that 20 years ago, but now it sounds way better. You won't notice live anymore, but it's still audible. To be honest, pitching them up with them sounding "higher" is actually better most of the time with House, Trance ... Dubstep/Trap ... keeping the original pitch is generally better.
The problem is that LLMs are just convincing enough that people DO trust them which is sort of a problem since AI slop is creeping into everything.

What can be done to solve it (while not perfect) is pretty powerful. You can force feed them the facts (RAG) and then verify the result. Which is way better than trusting LLMs while doing neither of those things (which is what a lot of people do today anyway). See the recent 5 cases of lawyers getting in trouble for ChatGPT hallucinating citations of case law.

LLMs write better than most college students so if you do those two things (RAG + check) you can get college graduate level writing with accurate facts... and that unlocks a bit of value out in the world.

Don't take my word for it look at the proposed valuations of AI companies. Clearly investors think there's something there. The good news is that it hasn't been solved yet so if someone wants to solve it there might be money on the table.
>For instance, my money would go a lot further in Russia, but then I'd have to live in Russia.

It's important to point that if you were moving into Russia as an expat, you've already avoided much of the opportunity costs of building your career there first and instead going in having "made it" in another country.

If you are starting out in China or Russia, it's much harder relatively to climb to a similar position within those countries than in USA. Alot of expats might like how much their money goes in China with good CoL, but I'd be suprised if they were to send their children through the conventional route of the Gaokao and ultracompetitive Chinaese University Admissions and labour market. Getting into the Ivy or Berekely or a State Flagship and then FAANG is cakewalk in contrast.
Some articles are more opinion than fact, even though they might be presented as fact
> You can only see their behavior, which is identical whether they are the same consciousness or a different one from the one it was yesterday.

The first clause of the sentence is true, but the second is not.

You never directly see a thing itself, you only ever see its effects on the world. You rationally postulate the presence of water because of its clear colour, its hydrating effect on you, its tendency to become a gas at 100C, its tendency to dissolve salt, and so on. Similarly, you rationally postulate the presence of the same person, at 10pm on Monday and 7am on Tuesday, because he has the same personality, the same look, the same eye and hair colour, the same body shape, etc. We know about the presence of a thing from the presence of its effects and behaviour. If these remain the same, it is rational to believe that the person remains the same.

> You don't even know whether they have any conscious experience at all.

Again, knowledge of effects leads to knowledge of the thing causing said effects. I am aware of my own conscious experience, I see Bob affects the world in ways that are very similar to myself and other human beings, and so I rationally postulate that he is a conscious, rational being like I am. You never see a person's mind directly, but you see the effects of the person's mind the whole time. You see such effects through their body. If the effects remain the same, or change only in certain, limited ways, it's reasonable to believe that the cause remains the same (and frankly crazy to believe otherwise).

> The "for practical purposes" points at your _body_. There is no evidence that an organic body is in any way special.

The mind and the body form one substance. The idea that "my mind is one thing, my body another" has been tried and failed as a philosophical idea several times in history. It raises far more problems than it purports to solve. I know I continue through time in part because my body continues through time. You say the body isn't "special"; I don't know what this means, but I know my body, and other people's bodies, are different from other things, because they walk, talk, reason, sense, desire, and so on. (Once again, the effects and behaviour of a thing lead us to knowledge of that thing.) The idea that consciousness or self can be 'uploaded', even in theory, is pure fantasy. You and your body are one thing.

> You can spin the illusion of a continuous conscious experience every way you want. It is still just that, an illusion.

If this is so, explain how rational thought is possible. Given that rational thought involves you reasoning from A to B to C through time, how is this possible if there is no continuous 'you' that is going through time?
Related to this, I read Daniel Graber’s “Bullshit Jobs” (there’s a book in addition to the essay, but the essay gets the point across just fine) and the essay the “Gervais Principle” and they really helped me understand the government and the corporate world early on in my career.

https://web.archive.org/web/20190906050523/http://www.strike...

https://www.ribbonfarm.com/2009/10/07/the-gervais-principle-...

My personal takeaway was that much of our work involves complete BS. Either join a useful, innovative startup and make a difference or play your part in the farce and take your paycheck.

I still work hard in some roles, but now it’s to get a raise/bonus, or because I find the work fun. It’s not for the sake of working hard anymore. If you want to work hard, go dig a hole.
Think of it as a polygon with about 4 km circumference: https://en.wiktionary.org/wiki/parsa#Noun
making a city walkable would be a great idea though, considering walking as a form of public transport literally has a cost of zero for the user.

Also, having a walkable city has massive health and societal benefits.
I had heard the phrase, but didn't know where it came from. Based on the wiki, I think I'm inclined to agree with the author. Do you recommend it? I could use something a bit less abstract than my typical fare...
That film is about as much based on truth as those "based on a true story" horror movies.
Then you'll be surprised to learn that the USA is the country that attracts the most international migrants by far.

https://www.statista.com/chart/30815/top-destination-countri...
Regarding the thesis of the article of bringing the instructions to the data, I'd love to see the core of that applied much more broadly in software / aaSes. Random services probably won't JIT LLVM IR for you, given the security of running untrusted LLVM IR … but there's also WASM out there. I'd love to see interfaces start having the capability of accepting WASM instead of an enumeration of the 2 use cases a PM thought I might have.

E.g., we use PagerDuty, and there's several places, such as routing pages, where I'd just like programmatic control, and code would express much more succinctly the needs of what I want to do than trying to express it through some UI-based "routing" editor thing.

Artifact storage aaS's often come with "cleanup" policies that let you choose between 2-3 different modes of cleanup, mostly wrong one way or another.

In all cases an enumeration of the names of 2-3 fixed functions, when I'd rather pass the function.

---

Since this is posted by the author… you set `.content a { word-break: break-all; }`? Like the name sort of implies, it permits line breaks anywhere, which means that the opening line renders as,

One paper that has been in the back of my mind is for a few years is Efficiently Compil
ing Efficient Query Plans for Modern Hardware1 which details how Tableau's internal

(I.e., it splits mid-syllable, and without a hyphenation (which is a different CSS property).)

The layout is basically fixed at the containing element's max-width for nearly any width someone might reasonably be using, so outside of font variations, it should basically always render like that (and I don't think font variations would make enough of a difference). (It steps up to a wider width at some point … but that width also lops a word on the opening line.)
Very true. My dad (late 60s) has written a DNS server, but still nearly fell for an email scam when he was sleep deprived and at the airport believing his flight was overbooked and he was going to be kicked.
DroidBot: Insights from a new Turkish MaaS fraud operation
Oracle files notice of appearance for JavaScript trademark [pdf]
The presentation of data was nice (slides with a constant format) and the measured amount of labeling was great
A few comments to help:

>> To enter into the wilderness there you can park your car in state park parking lot,

we don't have states or state parks, but provinces and the parks you visited were federal.

Banff, and to a lesser extent Jasper, are pretty tame with respect to "wilderness" but this is mostly a good thing! There's lots of facilities and you can experience them without needing to go into the remote backcountry - but it's there if/when you want to.

There are also electrified crossings with no gates, which always freak me out a bit. They feel like a trap.
To be fair, the real estate market in the US has always been super distorted (mostly due to the existence and availability of the 30-year fixed-rate mortgage itself), and encourages people to do stupid things. People should not consider their primary residence to be an investment; in truth it should be an expense and a liability. But the expectation here (fueled by market-distorting policy) is that home values always go up, and that homeowners can expect to sell their house in some amount of years at a profit.

As houses get older, their value should decrease. Even large-scale renovations often should not push the value up quite as much as one would hope. Certainly the value of land can go up, based on housing/zoning policy, coupled with supply and demand in a particular area.

At any rate, most things are temporary. Interest rates are headed downward again, and the Fed expects to make more cuts. Presumably we won't get back down to zero, but that's probably a good thing.

Also let's consider history: interest rates are still objectively not all that high right now. They're on par with or lower than what rates were in much of the 90s, and even some of the 00s. It's only the 10s that saw zero rates. And hell, go back to the 80s and prior, and the current rate situation looks delightfully low.

> High interest rates have also helped crash the real estate market, so even if you just own a home, you've taken a bath since the high interest policy has been implemented.

A note on this: so what? What matters is the cost of comparable housing. If my house has lost 25% of its value, it stands to reason that similar houses in similarly-desirable locations will have lost a similar amount, and still be affordable for me if I wanted to sell my house and move.

But again we run into the problems caused by the 30-year fixed-rate mortgage! Anyone who has bought a house with a mortgage recently enough, at a price high enough, might be in a situation where they can't move because they won't be able to sell their current house at a high enough price in order to pay off their mortgage (and still have enough of a down payment for their next house). This is a problem we've created for ourselves, and it's super annoying.
From Gates to Pixels: Making Your Own Graphics Hardware [video]
The article addresses this directly, arguing the point that the social safety net has a cost which is what is curtailing the economy in some respect:

For all its economic power, the US has the largest income inequality in the G7, coupled with the lowest life expectancy and the highest housing costs, according to the OECD. Market competition is limited and millions of workers endure unstable employment conditions.

Europe’s social safety net needs to be paid for, warned Christine Lagarde, president of the European Central Bank, in a speech in November. Boosting competitiveness is necessary for long-term prosperity, she argued: “Failure to do so could jeopardise our ability to generate the wealth needed to sustain our economic and social model.”
Does This Webscraper Exist?
Essentially, what I'm looking for is:

1) Here are all these links
2) Scrape the content from them and organize the data neatly into this database. Ideally, it should leverage AI to fill in missing information—such as automatically generating tags or categories when they're not provided by the scraped site.

TIA
It's a good point (made by sibling comment to yours too) but I do think it's a bit of a break-down in the intent of GDPR, or even 'not possible to satisfy requirement'?

Because from a user's perspective, my relationship is with news.ycombinator.com or whatever - I don't (have to) know or care if the site uses Cloudflare, that's some other company, maybe I haven't even heard of it or have any other relationship with it. But now it is a company that the one I knowingly have a relationship with is causing to be made aware of information which uniquely identifies me.

I didn't know there were anti-abuse/spam exceptions though, so I suppose that's it.
I originally linked to the “Controversies” section but felt that perhaps that would show my bias. ;)
Show HN: Neon Model Context Protocol Server
Suspicious Package: An Application for Inspecting macOS Installer Packages
> Achieving accuracy with RAG and LLMs is a challenging task that requires balancing precision and recall

The challenge is domain knowledge and not tech in my opinion. There are dozens if not hundreds of companies providing RAG and LLM, but the challenge is, like you pointed out, what should you do if you encounter something like "Ankara".

For BestBuy, this might not mean much, unless there is a BestBuy in Turkey. For a government related site, cities and geography is important, so trying to extract additional meaning from Ankara is probably important.
It’s called having world’s reserve currency plus leader in tech platforms and AI.
How big is your model?
That’s still not paycheck to paycheck. If you’re spending income on non necessities you could cut back and be just fine.

An aside, if you’re spending 100% of your income on just lifestyle stuff… you don’t to work at all if your retirement covers it.
I really believe in the ownership model, which is why I hate the Jira ticket-based development model so much.

There was a time in my company where a single developer, who owned the product, would ship an entire app in a year. Now we have a "cross-team" where you have to constantly manage all feedback and try to shut down stupid ideas from getting into the product. I really hate design by committee: all talk and no ownership.
Real wages (adjusted for inflation) have fallen since November 2020.

https://www.statista.com/chart/32428/inflation-and-wage-grow...
The people you see with tables full of firearms for sale at gun shows are literally all FFL dealers.
The Russian side seems quite proud of being evil. It's like year sure we murder and torture civilians, that's what makes us great.
You need someone else in your meeting to be using Amurex, since the transcription for someone else is already happening, we reuse that to give you the recap.
Unfortunately, I don’t recall exactly which sources I read on this, it was many years ago. I just recall that it started as one of those “wild link chases” on Wikipedia and ended up deep in some downloaded textbook PDFs :)

But I do recall enjoying diagrams such as this illustrating how different modern alphabets are related via historical counterparts (there are similar diagrams showing how Hebrew and Arabic emerges from Phoenician, as well as comparisons to runes):
https://en.m.wikipedia.org/wiki/Brahmi_script#/media/File%3A...

I also rather enjoyed reading about the history from Hieroglyphs, to Hieratic, to Phoenician (as well as Phoenician history in general). But unfortunately, don’t recall where. Start with Wikipedia :)
This is only an analysis of the surface level presentation style of Nietzsches work… not the ideas themselves, which he claimed he came up with while walking, not while writing. I can’t help but suspect that the author was unable to understand or evaluate the ideas themselves- which has been mostly the case with all of the English language translations as well- it’s hard to understand a translation when the translator did not. Carl Jungs seminar on Zarathustra is in my opinion the best presentation and analysis of Nietzsche’s ideas in English- because Jung actually understood them.
So we actually have 2 search tools. One is the one you see here, which is made to be less precise, but returns more results and returns them faster.

The other sounds more like what you are looking for. It returns a more focused set of results and actually generates PR summary reports as PDFs for our customers.

However, we can't really give a public demo to HN of this second one, because it takes 1-3 minutes per run and is quite computationally intensive. (And we were told that our HN launch should demo something the community can easily play around with).

That being said, if you want an example of the output of this second search tool, you can see it here: https://www.linkedin.com/posts/sandy-suh-2ba05bb0_parsagons-...

In short, I don't think you're doing anything wrong. I think you're looking for a more precise version of our product that we weren't able to provide a demo for
4.2k * 12 months = 50.4k -- so 20k under the bottom of the large range previously posted (70k-100k/yr)
I think the jobs numbers are somewhat fake. There are so many evergreen postings and stuff like outright fake postings.
it's legit, I just fought a flying snake and it was glorious
I've mostly lived in places that you might consider gun unfriendly. I don't own a gun and am not always comfortable in places where they are too present. I know enough about safety from friends that I've avoided shooting with certain people in my greater friend circle. That said, living in the mountain west friends of mine own guns, hunt, and one set of friends owned a gun related business for several years.

For the incidents 3 were school/university shootings, 3 were in malls or similar public locations, and 1 was a house party. I don't know of any real common theme beyond gatherings of people. One I included in the earlier post was a domestic incident with several deaths and so it might not belong with the others.

I've noticed my 50-60 year old friends and their children in high school are more concerned about school shootings than I ever was. That may just be excessive concern due to increased news coverage, but I think there is also something about the availability of guns and teenage brains that is a real concern for them.

My personal experience has only been hearing gunshots nearby, although one incident involved a death. I don't think of myself as being in dangerous places but it has happened more than a few times. Guns and gun violence aren't something I think about much at all, but when I do it's surprising by how much it touches my life and my friend's lives.

All that said, one thing I do appreciate about this country is the variety of it. A friend who grew up sheep ranching told me they were allowed knives up to a certain length and guns at his school. Meanwhile mine would have had a lock down if students did the same thing.
So what's the root of the issue?
When I was there, the experience here would've been more like "you see some comms on Workplace saying this thing went live".

For a small number of people, it would look like "It's your oncall week, and you unexpectedly receive a large diff stack from a complete stranger". Most engineers at Meta won't touch anything related to C++ during their tenure there, and you can safely assume all this stuff would be abstracted away from them.

If you are on a C++ project, odds are that your experience here would be "I'm on-call and got pinged by a random person saying they were submitting a diff stack to implement this feature". Except if your project was sufficiently large, you'd probably have known about this ages ago so the diff wouldn't actually be unexpected, nor the submitter a complete stranger.
Nice pseudo "news" reference; no possible bias there and not remotely related to this topic.

`Canada's National Observer (CNO) delivers vital reporting on the defining crisis of our time: climate change`
If you're looking for a generative AI model API only, I think Nova is not for you. If you want to build that capability into your cloud application, it uses exactly the model you expect and have, and you just add a new policy/role/whatever for whatever piece of it's going to use Nova.
because of uncontrolled money printing, duh.
The word "firefox" appears in the article once. The rest is AI, "rebranding", and "buy our merch."

If Mozilla ceases doing anything it would be an improvement. Their #1 priority right now should be making sure firefox maintains its bragging points as a non-Chromium MV2 browser and making sure they can survive the loss of Google's money. Instead we get Mr. Robot Goes To A DEI Conference In Zambia.
>Meta calling their approach "open" and what the OSI deems "open" are both flawed and/or misleading.[...] It's gotten to the point that whenever I see a Western publication, I groan.

llama weights are open, and Qwen 1.0 was based on llama,[0] so clearly those papers are useful to some people, even if some people want to be angry at Meta for not being open enough for them. In fact I would say Qwen is less useful than llama as their technical reports are not nearly as detailed as Meta's. Also, Why groan just from seeing the origin of a project? Just read it to see if it is open or not. And there are also lots of popular Chinese models that are completely closed with no code or paper eg. Hailuo, Kling, etc.

[0] https://arxiv.org/pdf/2309.16609 p. 6
AWS says AI could disrupt everything – and hopes it will do just that to Windows
The search startup trying to turn the web into a database
making a cheap EV (like the trabant/VW beetle for EV's) would be great.

Gas prices in europe are no joke, and considering we are basically in a hybrid war with one of the biggest oil producers for europe, getting rid of energy dependence would be great for europe, and having cheap EV's would be key to that.
And I see no sources that insurance companies had anything to do with it, just assertions.