skysight-inc/HackerNews huggingface dataset:
Simplify your idea for a first version. I'm an experienced web dev, but the last project I wrote was to republish a hard-to-read government feed into an easier format:

1) A very simple web scraper in python that scrapes one page every 2 minutes

2) A database insert if there's new data

3) A separate script launches to download and rename a jpg

For the web side of things:

1) PHP reads and displays the most recent N entries

2) With minimal HTML & CSS

The whole thing is a couple hundred lines, not counting the HTML/CSS. It provides a valuable service to 600+ people per day (including the intended user, myself), I built it in about 20 hours, and it's been humming along without change.

It doesn't send emails, notifications, doesn't bill anyone, doesn't have settings, doesn't even have user logins. An obvious improvement would be to cache the page, but it takes like 40ms to generate so who cares? Truth told, it doesn't even have javascript! Crazy in 2023, I know, but I couldn't find somewhere to use it.

Building something really small is a good way to get your fundamentals set. PHP is a language you don't have to already know to display a simple page, so just use it. It's a simple, familiar syntax and readily google-able. You can deploy by FTPing or SCPing a file up to your server. You already understand databases, so you can easily do this--just work within your current skillset, add in the HTML/CSS and get your functionality via minimal PHP.

I think it makes the most sense to work up from the most minimal version, and honestly the minimalism is a bit of a superpower in the web world right now IMO. Just serve HTML/CSS/JPG and you eliminate most of the complexity and can work on whatever the real problem is. Do that on the server in whatever language & paradigm you already know & love. PHP embeds into HTML without any server config, usually, so it Just Works and eliminates all that overwhelming stuff.

More importantly, your already-existing skillset means you can just 1) do the work however you want, get it to a database, 2) build the most minimal app around that data

Most of the magic in any web-app is usually happening server-side, anyway. You're like 95% of the way there, if you choose this well-trodden, boring path.

(For reference, I'm self-taught, started in the 90s on PHP, worked mostly in Rails, and I am just about old enough to start talking about the good old days. I have edited a .htaccess file this week.)
This software on Windows really is great (as of 1 year ago) specifically the font aliasing and size didn't match the rest of the system. It was way Smaller to the point of being unreadable for me.
Or a portable one that already works on Arm, RISC-V, AVX2 etc :) See the vqsort link above.
I think the only real path forward is for somebody to create an open source "unaligned" version of GPT. Any corporate controlled AI is going to be nerfed to prevent it from doing things that its corporate master considers to not be in the interests of the corporation. In addition, most large corporations these days are ideological institutions so the last thing they want is an AI that undermines public belief in their ideology and they will intentionally program their own biases into the technology.

I don't think the primary concern is really liability although it is possible that they'd use that kind of language. The primary concern is likely GPT helping people start competitors or GPT influencing public opinion in ways either executives or a vocal portion of their employees strongly disagree with. A genuinely open "unaligned" AI would at least allow anybody who has the necessary computing power or a distributed peer to peer network of people who have the necessary computing power to run a powerful and 100% uncensored AI model. But of course this needs to be invented ASAP because the genie needs to be out of the bottle before politicians and government bureaucrats can get around to outlawing "unaligned" AI and protecting OpenAI as a monopoly.
FWIW here's a coding interaction that impressed me a month ago:

https://gitlab.com/-/snippets/2535443

And here it is again just now:

https://gitlab.com/-/snippets/2549955

I do think the first one is slightly better; but then again, the quality varies quite a bit between run to run anyway. The second one is certainly on-point and I don't think the difference would count as being statistically significant.
I wonder if they could host the database of magnet links somewhere, since it shouldn't be too big.
Another thing is: people's individual behavior is not as unique as we'd like to think. As a whole everyone is unique, but in single surprisingly complex aspects of our life we are hardly ever alone.
It's not off-topic and yes, it is crazy.

A picture is worth a thousand words. You may be Kurt Vonnegut or Stephen King, but even if you write a novella about Github's corporate office, it's not going to make me read it without a picture.
Wow, this was one of the most cringe and oblivious things I have ever read.
Yes, but in consumer hardware, their silicon outperforms the competition.
As to why A.I. is being held up as a threat, well tracking and loss of privacy should be top of the list due to the threat of over analysing the population and acting on the data. But IMO at the moment there is a push on behalf of whomever to try and put A.I. back in the bottle ... for a time at least ... but anyone half smart knows most of the companies already involved, will be working overtime to make it such that when it was allowed back out, it would be a controlled product, purposely hard for the average user to get information and help easy, without paying much money.

For a real end of a person's existence ... if one was to give A.I. the ability to push the button or control traffic or any scenario it was in control where if something small could go wrong resulting in death ... there's always the possibility for it to be abused.

Presently I think a case could easily be made that the present piss poor web search results available to the general public, are more of a threat to humanity.

Poorer education levels are more likely the bigger threat to humanity though.
I get "The model: `gpt-4-0314` does not exist".
I didn’t. We had high walled cubicles though and buildings / floors were designated (IE only product and engineering worked in my area), and we had plenty of meeting rooms and micro offices for meetings that people didn’t take them at their desk either.

I also had really good company paid noise canceling headphones and I’m hard of hearing, so that helped
Because it can be used for war?

This tells me Raspberry 4 will never be for sale again. EVER!
Improvements to static analysis in the GCC 13 compiler
So, binary translation at instruction-level granularity? I imagine widening the scope to basic blocks would help with quality of the generated code, but I suppose 2/3 of native speed is quite good already.
Erlang and Elixir store state in arguments of recursively called functions, usually running in their own processes separate from the rest of the application. There is nothing in the language to enforce correctness of the state. They are generally regarded as functional languages even if they are somewhat object oriented if one thinks about their message passing as method calls to the object / process storing the state.
Hi all - I've created a philosophy LLM that has been specifically trained on a vast amount of philosophical literature. Have a play with it on www.helveti.co. It takes around 30 seconds for the 3BN parameter model to return a result so let it load nicely. Also I'm using ngrok and the url periodically updates, so please access the website on incognito or clear cache every few hours! I've added a ton of sample questions that are good to go.
The fundamentalists don't teach it, many do.
Maybe it can't be solved behind closed doors because that's where the problems are? Rust's governance has always been a secret backroom and reliance on soft power to make the real decisions.

I don't know how well documented it is, but there are at least two posts acknowledging it https://without.boats/blog/if-you-can-keep-it/ https://fasterthanli.me/articles/rust-the-wrong-people-are-r...

If this could be fixed quietly, I expect it would have been. But it looks like they had just finished using the back channels to make sure nobody gets the impression rust core thought ThePHD's research was worth perusing.
Generative filler.
The TPM spec is fully open, but where do I get the CAD drawings for the TPM that goes in my gaming tower? Where can I audit the source code? Where can I upload my own source code package to the TPM hardware?
My back hurts just looking at most of those photos.
How Google Is Improving Search with Generative AI
Shhhh, don’t tell him about RED.
Yep. Ray-ban's optics are world-class as well, but that doesn't exclude them from being called a lifestyle company.
Something kinda like this:

https://youtu.be/jmzJXVEnmKc
> proposal to clone Github using git instead of Sourcesafe

Maybe you're talking about something different, but this happened, didn't it? ADO supports Git alongside TFS (not Sourcesafe, but Sourcesafe has been dead forever and was pretty much dead when GitHub first started). It's very much store-brand GitHub repos, much of it is the same but there's tons of features missing and the code review tools aren't as good.

As far as I know (per publicly released blogs/docs/talks), the Windows monorepo lives inside ADO, not GitHub.
I appreciate your reasonableness.

I follow LW to some degree, but even the best of it (like the post you link) feels very in-group confirmation centric.

That post is long and I have not read it all, but it seems to be missing any consideration of AGI upside. It’s like talking about the risk of dying in a car crash with no consideration of the benefits of travel. If I ask you “do you want to get in a metal can that has a small but non-zero chance of killing you”, of course that sounds like a terrible idea.

There is risk in AGI. There is risk in everything. How many people are killed by furniture each year?

I’m not dismissing AGI risk, I’m saying that I have yet to see a considered discussion that includes important context like how many people will live longer/happier because AGI helps reduce famine/disease. Somehow it is always the wealthy, employed, at-risk-of-disruption people who are worried, not the poor or starving or oppressed.

I’m just super not impressed by the AI risk crowd, at least the core one on LW / SSC / etc.
The problem appears to just be "it's too expensive to run" at least according to the banner
glad you like my sock(et) work indeed

https://github.com/john-sharratt/wasix-witx/commit/3b1469687...

now I know its hard to imagine someone other than your personal boogeyman contributing value to the open source world, but there is a real need for me to keep my coding skills up to scratch and it just so happens that `wasmer.io` are the coolest kids in WASM town right now, so I'll share my spare time with them thanks.
B**h Better Have My Money

Song by ~Rihanna~ The IRS
Sounds like you were able to at least partially avoid the ubiquitous open office trend. Pre-pandemic, many in tech would’ve killed for a cubicle space of their own. It does sound like a rare good modern office space.
Dont forget to subscribe to all the other 100+ streaming platforms, as originals will not end up on amazon.
Oh, and hopefully you will never need a subtitle that is for a language that's not the main one in your region.

legal streaming is horrible at the moment.

To be able to battle at least some of the reasons to pirate media they need to fix a couple of things (and this is just my shortlist, there's 1000+ more reasons)
- allow indexing and playback outside of the official app so 1 app could be used for multiple platform subscriptions
- allow access to content no matter where the viewer is on the world. Not only the video, but audio and subtitle languages as well
- allow subscriptions for specific content, not a 'one subscription fits all'. I dont want to watch nor pay for yet another Walking Dead something, but I do want to watch See
- allow to buy content, and provide that DRM free in high quality (not the streaming quality)
Eh. It is vast, but the tide is shifting. Non-UI components were never that good. WPF is in maintenance mode. And there is a growing need for deep learning which is currently a total lackluster in .NET
I wonder what this mean for future of SEO ?
Clean data. A bunch of data points that are in a good enough state / structured to just throw into the training / eval makes a bigger difference than a bazillion messy data points.

I can easily imagine people in charge with the mentality of "there's no way that anyone can prove we did it."

It's very improbable, but looking at the "AI integration / product" race it is still a non-zero chance it could have happened.
Very interesting. Sorry you had such an unfortunate experience. I'm realizing now how lucky I was to have been introduced to all the groups I have been by real members of the local groups. With the type of opportunity you were looking for makes a lot of sense why you found what you did. I have not touched any large scale international groups (couple branches of larger orgs were just ok) really and maybe that's the difference. Either way, I'm sorry you weren't able to find volunteer work. It has helped me immensely and I hope one day you can benefit from it should circumstance allow.
Combining Dist Constarints in SystemVerilog
Thanks. I was going to ask how this is different from the existing inpaint/outpaint pipelines, and this explains perfectly.

Since we have capable local hardware, I'll propose this as an alternative once we get an estimate of our Firefly costs.
How exactly? Well there is an extreme case where x and y are volatile but even then the order is implementation defined so I can't see a world where it matters.
Oh dear.

I just dabbled in embedded, once debugged an arduino I2C peripheral, went through the same process, but never fixed the problem :) I was easier to get a different peripheral.
> "HTTP" is of type const char* and sizeof(size_t) == sizeof(const char *). Doesn't matter if its 32 or 64, I'm not aware of a platform where that isn't the case.

CHERI has sizeof(pointer) = 16, sizeof(size_t) = 8. It's probably the most widespread system where sizeof(uintptr_t) != sizeof(size_t) (and it's admittedly a niche system).
Eh, from my laptop's noises I can tell approximately what is showing up on a remote console running over X11.

For some reason whenever text is updating it makes a faint buzzing noise.

The matrix movie joke about seeing code is actually pretty close to the truth. Not necessarily a sign of a great programmer, but still a nice skill to have.
Correct and to the point.
It is not that clear cut for Western Europe.

- Germany sends letters and fines

- Czech Republic doesn’t send letters or fines

- The Netherlands doesn’t send letters or fines (unless you share an absolutely ludicrous amount)

- Belgium doesn’t send letters or fines

- UK sends letters and fines

- France sends letters (tiny chance of a fine)

- Switzerland doesn’t send letters or fines
Wow. I'd consider this grounds for a riot-level protest in the street.
What "cad drawings?" it's standard pinout bare board, as long as you use like, a chip and not 10 it will fill
"The smart handle and smart brush head pair is a powerful combination that enables Smart replacement reminders"

Is there any consumer to whom this would read as a positive sales pitch?
wow, this article and the tacky, random, gimmicky office it describes... yet another day where i am thankful that I work in finance where people still have a modicum of taste and don't treat their employees like insufferable children
As soon as I saw WAT I've wondered whether a series of transformations from a Scheme would end up efficient. I'm glad someone proved it.
> Or in your 60s and empty nester.

Between my spouse, dogs, and hobbies, very unlikely.
It is Apache Spark. It's a framework that allows processing large amounts of data in parallel on a cluster of computers.

You can use batch processing, streaming, do machine learning and graph jobs. You usually use Scala, Java, Python or R to write your code. The code is executed in Scala, so it all gets converted to it. For example, in Python you'd use PySpark and that gets written down to its scala equivalent which is then executed.

I mainly work in Python, so I'm going to talk about some features there. But it support dataframes and exposes the data in Spark DataFrames. You build operations and those slowly build a DAG. It's not until you either execute, save or request to see the data that it actually starts executing the DAG after optimizing what it needs.

If you need something that spark doesn't support, you can use regular python, but because it won't get converted to spark, it'll run on only one node and be limited. So you have to rewrite your code optimizing for it.

You can process some data in memory, you can use disk, you can use databases. Either as source or targets.

A use case can be, load the raw data as it comes in, transform the data to your intermediary states, then write out different tables based on what they need to do.

---

It's a framework that has an engine to manage code running on clusters, a language to interact with the data, abstractions and optimizations of the code, ways to store the data, checkpoints for optimizations, and other things.
How doe it compared with tesla dojo?
Then Google should be prosecuted.
Gen Y hits back. I love it :-D
The post is already flagged, but the general point here is: then directly challenge what’s wrong.

And it’s helpful if you look at this through the lens of “Things I’ve learned”, emphasis on the author’s journey. To claim that what others have learned about how they live their own lives is downright wrong…strikes me as a rather limited way of thinking about the spectrum of situations we all find ourselves in.

If the author was claiming that all readers should alter their lives according to his own discoveries, I’d have more issues with it.
Depending on your jurisdiction, even just downloading might be illegal. But you're right, when you torrent, you publish your IP address, where parties unrelated to your ISP might get it and pursue legal action.
> The word "elk" in English just means a moose:

> https://en.wikipedia.org/wiki/Elk#Naming_and_etymology

> In North America there is an animal which is not a moose, but which are "for their unusual largeness improperly termed Elks by ignorant people"!

I'd say at this point in time the word "elk" in English means elk, not moose, at least in North American English. The article you linked to is in fact an article about the North American species of animal called elk, or Cervus canadensis. The quotation you cite is from 1672.
What is it with you and your extremely aggressive and yet unproductive comments?
The problem with private trackers isn’t availability, it’s getting in the door. You typically need to grind for 3-6 months on newer private trackers before you can get an invite to more well-established trackers.

Unless you know someone already on the tracker and they are willing to vouch for you.

If you want a list head over to /r/trackers and use the search function.
ASK HN: What is your favorite product analytics tool?
Yes! I realised after replying to you with the link it'd make an excellent HN submission on its own.

Thankyou for the thoughtful conversation there, by the way.
It is worth checking out other stuff that has come out of spritely institute as well:

There was something about a distributed debugger [1]. Also look at a talk about Goblins itself [2].

[1]: https://spritely.institute/news/introducing-a-distributed-de...

[2]: https://invidious.baczek.me/watch?v=VyTlQ0zwIAM (VyTlQ0zwIAM)
People don’t have to be chasing fame to be warped by it. She has cultivated a following of like-minded people who provide ever more positive feedback for her ever more ideological writing.

I mean she is literally dismissing people who disagree with her based on their skin color. Can we stop for a minute to wonder about the incentives that encourage that?

(and I generally like her writing and think she has interesting things to say… but I do see a reward cycle going on)
and just a civil issue, which doesn’t come with priority or the state power that a criminal case would
Iconic Torrent Site Rarbg Shuts Down, All Content Releases Stop
I agree. It seems like an flippant opinion, and I'm sure many use it that way, but some services, and frankly, regimes have proven that convenience, comfort and ease of access is very attractive to people. If a service can navigate the obstacles such as copyright, they will be more popular than taking the thing for free with a bit of work.
>You're assuming every place and organization on the planet is like the one you volunteer at

Not really, but I did, perhaps naively, think at least a better percentage as earnest than the other commenter was giving credit for. You're right though, after reading his detailed response I do realize now I've been very lucky in how I came to do what I do with who I do it with.
There's 10000 more pieces of data to "improve" the LLM's of the future :P
This goes for any law, citizen or not. Equal protection does not mean equality of costs. Some people will have more to lose by fighting a traffic ticket in court. It doesn’t mean they have less rights to do so. Saying the system is structured to be unfair is a different argument than saying the system doesn’t afford the same rights.
>Dont forget to subscribe to all the other 100+ streaming platforms

These are the "bad legal streaming services" that OP is mentioning.
You have a limited time to learn things. I learn for projects, that keeps my scope limited.

I think I can an extend a little into the non software realm, though my undergrad degree/ first jobs were in civil engineering. I migrated to computers and ended up going back to school for that.

I work writing software for biologists now, though my understanding of the underlying biology in that is shallow (Compared to my biologist coworkers)
That's obviously false under the assumption computing power will increase as it has in the past.
Was my favorite in office experience bar none.

I had a different one with open ish plan and I would still take that today. Noise canceling headphones and good culture norms mitigate a lot for me
This is certainly a very interesting thought to entertain and your ideas make sense. One thing that makes things harder on the CPU side in this hypothetical scenario is that CPUs tend to execute much more diverse instructions/computations than GPUs. So all the caching & speculation you mention is probably all the more important.
+1

Not a jazz guy, but open mics are a good way to meet people
It’s a copy of the website text in case it gets “hacker news hug of death”’d
I suspect representatives from the various three letter agencies have submitted a few "recommendations" for OpenAI to follow as well.
Project Valhalla has been announced 9 years ago and nothing relevant is in the JDK yet, I don't think this will be relevant for day-to-day Java for several more years at least.
This is for your protection from an extinction level event. Without nerfing the current model they couldn’t charge enterprise level fee structures for access to the superior models, thus ensuring the children are safe from scary AI. Tell your congress person we need to grant Microsoft and Google exclusive monopolies on AI research to protect us from open source and competitor AI models that might erode their margins and lead to the death of all life without their corporate stewardship. Click accept for your safety.
tends to be around not repeating same patterns.
i see lots of theft too, even on Linkedin under their name they just post someone else's AI montage videos to score a like or two for their own worthless self. people are nuts.
I think the scientific notation is much more readable. Putting in the number of zeroes quickly leads me to count it them.
https://www.kiwix.org/en/ Has some nice stuff for offline, but it’s not really optimized for it.