skysight-inc/HackerNews huggingface dataset:
Just as background for people who don't work with this stuff much, this is my understanding.

Naive Bayes is an application of Bayes Theorem to classification problems in machine learning. The problem it is solving is where you are trying to classify something and you have a fairly large number of features. The example that is frequently used in the ML community is imagine you have an image and you want to classify it as containing a cat (or not)[1]. The conditional probability you want is P(cat|pixels) or more specifically P(cat|p_1, p_2, ...., p_n) where p_i is a given pixel[2]. The problem is if you want to apply Bayes theorem you would want to calculate all those conditional probabilities and multiply them together. Since each conditional probability is small this would trend to zero in an actual floating point calculation and by the time you apply Bayes you would end up dividing by zero.

To work around this you make the "naive" (aka very obviously wrong) assumption that the probabilities P(cat|p_i) are independent. Then you get to just sum rather than multiply and the problem goes away. The Naive Bayes classifier turns out very useful in spite of the fact that this assumption is definitely wrong. The slightly different problem that arises that a few other people have mentioned is it means that since you are summing if your feature is say a word then as your text gets longer the score gets higher. So long ham emails would get classified as spam if you just used a threshold.

[1] The computer vision community seems weirdly obsessed with classifying cat photos

[2] in the spam filter case you're looking at P(spam|w_i) where W is a bag of words.
> and still be using an enormous amount of automation to deal with the database drivers and moving data between your objects and rows

I've found I would generally only need the handling of database drivers and query building since I'm already writing a validation layer and to add data marshalling to that is pretty trivial.

Likewise practicing YAGNI, what is the chances I need multiple database drivers for different databases, it's extremely unlikely that I'm going to be chopping and changing between different databases so I'm really only writing that code once.

I would argue to start with writing the basic SQL queries and adding an ORM later when you know you actually need it.

It's much easier to onboard someone into pure python code + a db driver vs having to onboard someone to SQLAlchemy, since it is quite a complex piece of software, necessarily complex for what it is trying to achieve but if you don't need it it's not a good fit.
I'd say, if you find joy in soldering and DIY electronics, something like this could be great. It's hard to say without hearing it...

I really think a first synth (I know you already have one, but it seems like you're unhappy with it...), should be a polyphonic one. I went a similar route as you, but with a Behringer Neutron, and it was fun, but I immediately wanted something more.

Anyway, If you've got the itch for a new instrument, get a Microfreak, or a Minifreak from Arturia instead of either of these. Microfreak is paraphonic, so not full polyphony, but you can play chords, and when I use mine I don't miss having 1 filter per voice.
In my experience I pay attention to every social media place my stuff gets posted. I learn a lot that way.
IIRC ARM did end up licensing the SuperH patents about that. I tend to think SuperH could have been much more of a contender had Hitachi been more willing to license it for integration by others.

The one that mystified me was why anyone thought MIPS was viable in this space, other than the fact that it existed. Ultimately MIPS utterly failed to take advantage of their very big wins.
> ADS-B is not guaranteed to be available from all aircraft in most of the airspace below 10K feet MSL.

Sure, but so what? The lack of universality is not an impediment to implementing a new TCAS system that uses ADS-B data when it's available. (And BTW, the places where ADS-B is not required are generally places where traffic is sparse and so the risk of a collision is pretty low to begin with.)
I picked up some SQL knowledge through osmosis by using ActiveRecord and I do wish there was a better connect between what the ORM did and the end result. There were some tools to see what code generated what queries but it was not that intuitive and in your face like for example how you would have to deep dive frequently in your generated front end javascript and css code.

In other word I think there are some tooling left on the table that can assist in increasing SQL literacy and comprehension.
ChatGPT at least seems like it is trying to help me.

The meta games going on in SO are a whole lot more of a mess and ChatGPT is more than happy to hear my question a 3rd time and spit out the same answer as before but change a few things. SO, not so much.
captive portals are a pain everywhere

I routinely see them fail on mobile devices (phones and tablets) and laptops

My personal failure rate with captive portals is at least 50% - and that's on macOS, iOS, Android, and Windows
I agree. For example just prepending "Question" to a sentence ending in a "?" did not convey anything more to me. Worse the Question that this OP posted in his example could have actually been constructed in a safer manner if safety was what this environment was most under threat. I did sense there was a need to robotify humans and sure enough the "Source" confirmed it (Google Software Engineering Practices)!
That describes a past gig of mine which was fantastically successful. I was handed a messy 3000-line Jupyter notebook which contained the prototype of a great product, and given the task of productionizing it.

In fact, this is what I've done at several startups now: take prototypes and productionize them. At this point, I'm almost a specialist in transitioning from early stage to growth stage. I can do prototyping, but I recognize that productionizing is my stronger suit.

The technology for the prototype doesn't matter — Jupyter is fine. In fact, it's better if the prototype is shite because then it makes it easier to make it the "one to throw away".
I believe the reason you and the person you're replying to disagree, is that it works for existing debugger statements, but seemingly doesn't work for debugger statements injected after you toggle the flag.

The "disable breakpoints" button is seemingly performing a one-time imperative action on toggle (maybe "find all the breakpoints + debugger statements in existing loaded code, and patch/unpatch them") rather than being a declarative state-change in the system (i.e. "disable this tab's access to the debugger/breakpoint logic itself").
I readily admit I haven't looked super deeply into Filecoin but I thought they were trying to cryptocurrency the pinning problem, and thus not "for free" right?
We don’t need government run housing arrangements. What we need are market regulations, like rent control, that work. Having the government as an available lender, to ensure capital access for developers, isn’t control, it’s working the levers of capitalism to encourage an outcome.

Look at Texas - zoning-free, no rent control, and it’s quickly becoming a housing dystopia. Prices are rising rapidly, and as you build out so quickly, your taxes rise as a clip more than twice most places, to build new schools and hire teachers and build roads, etc. and guess what? Private equity firms are snapping up homes at a huge clip, 25% nationally and much higher in Texas, and then rent them out according to algorithms that maximize their profits (in collusion with other landlords using the same software). Why build a Rube Goldberg machine to impact housing prices though the elimination of zoning, when you can affect it directly through rent control and directly incentivizing new construction of cheap units?
If you'd like to feel extra uncomfortable next time you get on an airplane, read a bit more about limitations of TCAS that still exist today. For example, it doesn't actually model aircraft performance, so TCAS occasionally issues resolution advisories that are not physically possible. It also does not integrate with terrain awareness, so sometimes to avoid a collision with an aircraft it may suggest flying into a mountain (pilots are instructed to ignore TCAS RAs in this situation).
"Optimising for efficiency" on a personal/personnel/social level is one of the most common forms of rudeness in every day life. It generally _is_ rudeness.
I’m not sure the social media companies are liable for promoting the above. They’re not liable for publishing it (which is reasonable, since otherwise they would need to approve every post).

Ultimately, the law needs to figure out who is liable for actions taken by machine learning algorithms.
I have noticed a few ads slip past uBlock the past few days. They dont have video just audio.
Can you make one for Firefox too? ;-)
That's not true. A .400 OBP is attainable by the best baseball players and has been done over a season or even career many times.

Juan Soto, who is currently playing, has a career .421 OBP.

A .333 OBP in MLB, depending on the player's position and what year it is, would be OK. Not great, certainly not the best.
Most "Data Scientists" I've encountered are pretty much doing basic software engineering ETL projects.
The opening Google trends graph doesn't match the preceding claim about a material decline in usage at all... it says a lot more about the extraordinary rise of chatgpt (especially since most people aren't using chatgpt for programming questions). It feels like a "Facebook is dead" type of argument: popular but wrong.
I don't think that's the case for Android GPU drivers. The kernel driver is just an out of tree kernel module.
I think this is sound advice. What I’d add builds on this point:

> he does not see the situation as you do

At the moment you may be lacking the perspective of the founder, perhaps the coaching and input they’ve had from investors and other advisors on the direction of the business. I would go into a conversation with the founder but seek to gain a true understanding of their perspective as much as to emphasise your own point.

> we unanimously felt that the product works, and the team is amazing

It takes more than a working product and an amazing team to make a startup succeed. The product might be amazing but do the unit economics work? Is there a market fit? Does the market fit scale? Is there something that needs to be hit to secure the next round of funding? Maybe you have this info and omitted it for brevity in your post… but if you approach your investors for a dialogue without a complete understanding of this side of the equation I’d say your in for a rough time.
Also, if you have a bad manager who likes to gaslight you with questions that make you doubt yourself, a code review is a great way to pass on the good feelings to your co-workers. Make sure to ask plenty of leading questions that interrogate the competence of the author. The more passive-aggressive the better. And word it so that you can deny anyone that calls you out for negative behavior.

I don’t understand this line here, could you tell me why you decided to go this route?

Why are you using this function? Do you not know about the <design pattern/structure/API I would have used>?

Make sure to leave the author wondering what they could have done differently with their lives in order to avoid having to interact with you. But word it so harmlessly that they can’t tell if you’re genuinely interested in helping the team ship code or whether you’d push them under a bus if it helped you cross the street.
Lovely attitude, you have a nice day too.

There's others expressing the same concerns, for example https://news.ycombinator.com/item?id=37101393
DS was always an overloaded title - speciation into various other titles is ultimately good and indicates a healthy and maturing ecosystem. You still need DS though, in the multi-armed bandit that is your organization your real DS are your explore function - they figure out what to do. The other roles are exploit - they do it.
I have found it's more practical to invert this train of thought and work backwards. In most codebases I've worked in, there are fairly clear divisions of labor between vanilla line of business code and critical path code that merits extra infrastructural investment.

Working backwards from the critical path code to reinforce it with the infrastructure it needs to support robustness and ease of maintainability is valuable because it makes the path to ROI for the business very clear, and candidly, there is often lots of code that just wouldn't be high ROI to reinforce too much.
I abandoned trying to resolve the captcha after the 4th one.
> we have only one purpose

The problem to me always seemed like the goals of the company didn’t line up with the goals of many (most?) of its users.
I use chatgpt as a rubber duck who I’m suspicious of. Way too often it just comes up with fictional features
Obligatory: https://github.com/LibreScore/dl-librescore
We have a print job "triplicator" that I wrote about 12 years back to replicate three part dot matrix paper on a laser/mfp.

The employee works at a branch office that used to have a really good connection but now has an awful 50/12 adsl link.

They connect to our remote desktop server to our accounting software - create a proof of delivery that is printed via the triplicator to their local mfp machine which can take a moment to actually print.

When we moved from the 100mbps mpls link to the crap adsl there were some issues with printing the delivery notes, which we had to work around, but this is now recorded in people's memories as an ongoing issue - which it's not.

So, the issue is they believe they've processed the delivery notes and printed them, but they never appear. We can prove they've not been processed or printed due to database entries and logs, but the employee is adamant she's done them, and she's a great employee bar this one thing so hr and her manager don't push back.
On the whole though you would agree progress has been made, right? In a world with imperfect knowledge you do the best you can with the information you have.

The response to a paper ought not be, “This paper is bogus because they didn’t control for all variables.”. If the paper is bogus then give reasons for why this is the case. Was the statistical analysis wrong? Are there reasons why this can’t be true? Is this new information worthy of further investigation?

It’s sloppy thinking to say it’s a bad paper without having studied the issue and the data.
I really don't buy it. There is considerably more interest in google trends for ChatGPT compared to StackOverflow. But I dont see one replacing the other. At least for me.

I do not believe the google trend graphs,like "the scariest graph", in this post accurately reflect a decline of SO.

There is a place for AI tools and StackOverflow is not the friendliest of places but the quality disparity between the answers you get when comparing the two is very clear to me.

> This year, overall, we’re seeing an average of ~5% less traffic compared to 2022. Stack Overflow remains a trusted resource for millions of developers and technologists.
[...]
Conversely, in April of this year, we saw an above average traffic decrease (~14%), which we can likely attribute to developers trying GPT-4 after it was released in March.

https://stackoverflow.blog/2023/08/08/insights-into-stack-ov...
To me, that’s a subcomponent of severity
You're telling me this stupid, bizarre thing: that Google's major innovation was an HR process.

That's fucked-in-the-head just enough that you've made me wonder if it's true.
Do y'all really use ChatGPT for coding questions? Every time I have tried, the answer I get is entirely wrong, and I end up going back to either first party documentation, or Stack Exchange.
Lots of analog tools in this space. Some are

* Bullet Journal - https://bulletjournal.com/

* Getting Things Done - https://gettingthingsdone.com/

* Johnny Decimal - https://johnnydecimal.com/

* Zettelkasten - https://en.m.wikipedia.org/wiki/Zettelkasten

The last I point to Wikipedia, as there are many styles and alternatives of the idea of a "slipbox" and taking notes and the like.

I am partial to Scott Scheper's Antinet Zettelkasten, in the tradition of Niklas Luhmann.
Show HN: Open-source model to chat with your documents/data
Some of my most recent ChatGPT interactions:

34.223.203.0/28 what is the end ip of this range?

Write python code to strip out characters that are not alphanumeric or spaces

How do make FastAPI not return nulls in the response model when values don't exist?

Rewrite this javascript to python <snippet of javascript code>

Braindead stuff that I would normally lookup on StackOverflow but ChatGPT gives me the actual answer instead of me having to sift through comments. Also the last one is not something that's suited to StackOverflow. I feel I may be getting dumber, but also programming is not all that interesting to me that I would care to remember the details of any of these things.
I should've been a great fit for stack exchange. I love technical communities and have been writing code for several decades. But they did not have a particularly welcoming experience for new contributors (perhaps by design?) so I wasn't ever really able to get the flywheel started and never ended up contributing much.

I wonder if there's a systems lesson to be learned here around communities that do a good job welcoming new people and creating a magical onboarding experience staying vibrant for longer.
I wouldn't say exactly that, rather that a refusal to compromise ultimately results in choosing the status quo, and is therefore an effectively conservative choice. The words all mean the same things, it's the choices that are contradictory.
Yup, that will clearly steer people away from political extremes.
Do you realize where you are? Poe's law, man.

You're on a board frequented not just by technical types, but MBA's as well (VC).

Sometimes, as tempting as it is to post a sarcastic remark, it's better to just remain silent rather than sowing the seeds of misery by making $exceedingly_bad_idea tangible to the PHB who'll eventually try to get people to implement it for them.

If you don't want to see it, don't bring it up in any way. Lord knows, the fool is out there that'll think "that's a revolutionary idea!"
A bike shed (any colour will do) on greener grass (1999)
> When she moved over to AI, though, it was immediately clear that there was something very wrong. “There were no Black people — literally no Black people,” says Gebru, who was born and raised in Ethiopia.

Is that the problem with AI?

> Fast-forward two years and LLMs are everywhere — they’re writing term papers for college students and recipes for home chefs. A few publishers are using them to replace the words of human journalists. At least one chatbot told a reporter to leave his wife. We’re all worried they’re coming for our jobs.

That sounds like a different, and more universal, problem.
There are metrics that describe such standards. One such is the University of Würzburg's Democracy Matrix, another is the Corruption Perception Index.
Is "social isolation" inherently a bad thing?

Every family approaches family rules/dynamics differently

30 years ago, it was "who has the Game Boy" or "why can't I have a Walkman"

In 20 years, it will be something different yet again

We do not let our kids have real phones (they can play with old ones sometimes), and they can only use tablets or laptops for educational purposes (and an occasional (and time-limited) game)

Somehow all of humanity managed to survive for millennia without cell phones, smartphones, etc - your kids will, too :)
Might be off-topic but this feels like one of the better sites on my mobile device: works well, the padding/whitespace is on point and the fonts and their sizes are wonderfully readable. What a pleasant experience.
Our press doesn’t even protect the press at this point. We have all seen the tables pairing heads of each major news outlets with their respective political spouses, siblings, or parents. Gellhorn prize winner Julian Assange has been persecuted by the US intel complex for well over a decade.

The choice is in your hands to continue to attribute credibility to institutions that may no longer merit it.
It's all blocked because Galactus still doesn't support ISO timestamps.

https://youtu.be/y8OnoxKotPQ
Yeah. You still need a way to reflect the discovered MTU value to the sender somehow, but this can be taken care of by higher-level protocols.
That is certainly plausible and worth looking into.
> the calm demeanor shown by both ATC and pilots. Even in situations that make me cringe sitting at my laptop, everybody involved is steady. I know it's their job, but it still amazes me.

It's actually probably not as amazing as it seems. I was just on a high ropes course, and it's similar to ATC in that if things go pear-shaped, there is just nothing that you can do. So when I saw something going wrong [1], the instinct I had to immediately run and try to help was suppressed, and instead I (and everybody else) was essentially in the same calm-and-collected mood.

[1] Admittedly, this is wrong in the "abnormal operation" sense, not "immediate risk to life" sense.
No idea. Open source seems to come and go in waves. It has pros and cons as a business model. Personally I prefer working on open source because my GitHub becomes my resume, whereas in closed source interviews are needed to determine basic skills.
I'm not saying social media companies are liable.

Someone needs to be liable for any illegal activities. Most likely it's the user.
sounds great, do you have plans to port it to Firefox?

Does anyone know an equivalent that do the same thing on Firefox?
Yeah that’s right : typo
this is one place where middlemen actually shine imho, like apple managing your app subscriptions for you all in once place making them easy to cancel
Handling Pushback in Code Reviews
You’re assuming the bulk of ChatGPT’s coding knowledge comes from stack overflow. I suspect training directly on code bases and documentation is more important.
Ford's business is selling as many F150's as possible. Due to the way fuel efficiency regulations work in this country it makes sense for them to axe sedans from their lineup and replace them with large cars that can be classified as trucks because their more fuel efficient "trucks" can counteract the fine they would get from selling fuel inefficient F150s.
Very interesting, I'll watch for the quantized version.
That language is called OCaml.
Code review is a flawed process, especially for junior engineers. You spend time and effort, maybe days of work, getting this to work, and then some know-it-all leaves a bunch of nit-picky comments or tells you you're doing it wrong.

I tell most of the juniors I work with to work defensively against this using a few strategies:

- smaller PRs. Break the work up any way you can. Make small tickets or submit your PRs with Part 1, part 2, etc. You can't release half-baked work, but you can usually find opportunities to split things up. Nobody should be submitting 20 file PRs and not expecting a lot of comments.

- Validate your strategy before building it. If there's a senior engineer in your team who nitpicks your code, get their buy-in before writing it.

- often bad code is the result of not really knowing how to approach a problem. Don't just write the code and slap together a PR. You might need to figure out a working solution, then go back and tweak it and refactor it before submitting it.

- review your own PRs and use a critical eye. You'll catch the low hanging fruit (like forgetting console.log calls). Every time you have the urge to leave a comment justifying a choice, question whether it's the right choice at all.