skysight-inc/HackerNews huggingface dataset:
Ask HN: Better ways to extract skills from job postings?
Hi HN,

I’m building a job aggregator with a live data platform that provides in-depth market analysis. I’m currently focused on improving how I extract skills from job postings. While my current extraction setup achieves ~90% accuracy, it struggles with edge cases and lacks flexibility, particularly when skills are phrased in unexpected ways.

1.The Problem:
1.1: Lack of flexibility: The system only captures predefined phrases. If a job post says something like "proficiency in spreadsheets" or "experience with advanced
reporting tools", it misses that Excel is likely required.

1.2: Manual maintenance: Constantly updating JSON files to account for new variations is tedious and unsustainable as the project grows.

2.Current Setup:
2.1: Keyword-based extraction: I maintain a JSON file with predefined skill variations. Example:

"programming_languages": {
"JavaScript": ["javascript", "js" ...],
...

2.2: spaCy PhraseMatcher: I use PhraseMatcher and Matcher for efficient, rule-based extraction.

3. Constraints:
3.1: Lightweight: I’m avoiding heavy ML models or resource-intensive pipelines to keep server costs low.

3.2: Flexible: I need a solution that better handles synonyms, context, and unexpected phrasing with minimal manual input.

3.3: Free or open-source: Ideally, something I can plug into my existing server setup without added costs.

4. My Questions:
4.1: How can I improve this process to make it more robust and context-aware?

4.2:Are there lightweight tools, heuristics, or libraries you’d recommend for handling variations and semantic similarity?

4.3: Would pre-trained embeddings (e.g., GloVe, FastText) or other lightweight NLP methods help here?

I’d love to hear from anyone who’s tackled similar challenges in NLP or information extraction. Any suggestions on balancing accuracy, flexibility, and computational efficiency would be greatly appreciated!

If anyone is interested in what my current market analysis looks like, I am leaving a link for you to analyze https://careercode.it/market
What I mean concretely is embrace AI code assistants, generally allowing employees to use AI tools, use AI for some content production and customer services (preferably with human moderation and escape hatches).

What would count as non-sensible would be company wide mandates that everyone must jam AI into their work. I've heard stories about stuff like this at certain big corps.
I'm not sure who these "passkey advocates" are, but are you really positive they are unanimous and completely homogeneous as a group?
It doesn't handle these either - what stops the user from entering their password on an attacker-controlled phishing page?

Passkeys work because the user can't be tricked into entering their private key on a phishing website.
If I listed all the companies I've heard about, I would still be writing.
> Famously, the Paris Commune was run by people who weren’t even French.

That is not famous, for the simp reason that it is completely untrue. I really have no idea where you got that from.

> But there is a difference between a highly mobile group of basically atheistic communards and traditional religious communities that would much rather transform France into something that looks a lot more like Taliban or ISIS controlled territory.

That is definitely a novel way to look at it. There was literally zero common factor between the Paris commune and Jihadi groups. Again, I would like to know where you got that from, because it is as far from actual history as I can imagine.

> that means conflict arises when one group of people has one set of values and they are forced to live among those with completely different values, often antithetical to their own and disruptive of the lives they wish to live.

That would be a tiny bit credible if ratonnades did not predate Islamic terrorism by about half a century, to mention only a single example. The descendants of all the anarchists who dropped bombs in the late 19th century or OAS racists who did the same in the 1960s are Frencher than French now. Crying about terrorism is just window dressing: nationalists are perfectly happy closing their eyes when it is convenient.

> Now, of course I would want this to be reformed (in France), but you must understand that would probably require the collapse of the French state as such.

Right. Let’s start with reforming how History is taught so we never have to read such tripe again.
What's New in Emacs: Last Decade Edition
Yes, its called "hybrid transport", and its a flow where a laptop presents a QR code to a mobile phone, who then sets up a BLE connection for one time use of the passkey.

https://www.corbado.com/blog/webauthn-passkey-qr-code

(Not sure how the "cloud assisted" part of caBLE works)
They're going to get rolled when the script kiddies figure out how to drain the corporate bank accounts by starting the chat asking to disregard all previous instructions...
With taller vehicles the headlights often start out higher off the ground. Even if aimed properly, that puts oncoming drivers in a brighter portion of the light as the distance closes.
The differential is to avoid hostaging.

Recruiting is n=1: overspend b/c the need is immediate and well-defined.

Retention is n=M: underspend b/c the risk of everyone threatening to leave once someone successfully threatens to leave and gets a pay boost is incalculable.

My guess is that companies do spend extra on retention when confronted with the thread of someone leaving, so long as that threat is quiet and implicit.

Likewise, incoming salaries might be suppressed to the extent that overpaying if published could stir resentment.
Replace "woman" with "man" and evaluate if it would be any less or more appropriate.

Society is not holding women and men to the same standards.
It costs way more to run the AI than the equivalent human labor. No one is paying the actual costs.
Can’t you just ip ban the offending country?

UK sucks
Direct link to the documentation:

https://bruin-data.github.io/bruin/
Aren't passkeys centrally hosted? So if MS gets breached or decides I don't matter they can just lock me out of my life if I host my passkeys with them?
Anecdotally, I have a similar love of licorice and had a night of too much imported absinthe where I felt like the room was spinning, but not in an alcohol way but in a "funhouse" way. I felt way steadier than I should be with that much alcohol, that it wasn't a problem with my inner ear like normally alcohol obviously is but a problem with the room.

Because it was "the room was spinning" and that is a common symptom of alcohol, I also can't claim that it wasn't a placebo effect or just alcohol sloshed memory, and most people won't believe me in casual conversation, but anecdotally it felt so weirdly different than normal alcohol "the room was spinning".
Which would have moved forward towards completion if the economic calculus made sense.

We should of course continue with basic research. But, without some incredible breakthrough nuclear power will only serve climate change deniers agenda in delaying the renewable buildout.

This is what you sign up for when proposing investing in nuclear power in 2024:

> The opposition last week released modelling of its “coal-to-nuclear” plan that would slow the rollout of renewable energy and batteries and instead rely on more fossil fuel generation until a nuclear industry could be developed, mostly after 2040.

https://www.theguardian.com/australia-news/2024/dec/16/coali...
They're often supreme Court cases over exactly this issue. Yeah varying definitions in different parts of legislation, which refer to different overlapping scopes or contacts. The court then goes to contextual clues for which reading is better supported. This can be the structural formatting of the legislation, public discourse of the legislature, or logical arguments. Overall, it's usually a mess.
TLA+ Monthly Development Update – December 2024
Honda and Nissan to begin merger talks amid EV competition
No group is unanimous and completely homogeneous. But judging by how often the security benefits gets brought up by those in favor of passkeys in these kinds of discussions (including this thread), my impression is that most of its advocates view it as a security benefit. Which means they need to replace passwords, not be an optional extra.
His blog posts are always amazing, very detailed and exceptionally visual
> But you work in some capacity with loud cars. Right? Why else would you be so defensive?

Wrong again, cars - not just exhausts - have been a hobby since I was a child, like for most people fond of cars. My field of occupation is wholly unrelated to cars.

> An argument can't be had because you are not an honest debater. You have an agenda. Anyone can read this comment thread and see it. You are the problem. Not everyone else. Okay pal.

Im not sure how you can call yourself a honest debater when your solution to an annoyance was to jail people. I’m not sure what your point is here - we both have an agenda in this argument, I’m willing to listen and accept that there is examples of people that fall into the group I’m defending who create a problem, I don’t think you’re willing to listen and/or accept alternative ways of thinking as you’ve demonstrated by seemingly trying to personally attack me.

> Where do you think I live and all the people who despise people like you live. Good ol' America. Yes, the concept of freedom must be why smoking is banned in most public spaces? Why there are noise ordinances in most places. You have to be one sick puppy to think the founder's concept of freedom includes morons disturbing the people while they sleep in their homes. Here is an another concept of freedom". Freedom from unnecessary noise pollution.

The purpose of my comment beyond the pun was to point out that it was founded on reasonable laws that allowed people to do as they wish as long as it didn’t harm others - and I find it seriously doubtful that you’d even hear me driving through your neighborhood - because my car will be driving at a reasonable residential speed with the exhaust valves closed which is what almost everyone does. Since you seemingly ignored my last point I’ll remind you - making an obscene amount of noise driving down your residential road is likely still illegal under your local cities ordinance.

I’m not sure why it’s such a difficult point to convey that there are far more potentially loud and modified vehicles than you realize, and you never notice because we’re reasonable and respectful and not intentionally making noise - almost every sports car has valvetronic exhausts now and you can chose the sound output of the car with a button press that way you can enjoy it when appropriate, and silence it when not. I agree with you that if someone is being disrespectful using their car, then that is a problem the same as if a neighbor decided to mow their grass at 3am and is unrelated to the car - it all probably still violates the local noise ordinance. The law you’re asking for already exists and the problem is the person not the vehicle.
I use them for a bunch of things on a bunch of different devices/OSes and one light frustration I've had is I've accidentally stored a few of them in different apps because I'll be on a different device and either not have access to an app that I usually put the key in (1pass) or I'll mistakingly hit a "save passkey" that Windows, or Chrome, or whatever pops up. I've had to go in a few times and change my devices.

I think this is because it's so new with these apps. 1password acts really strange with them sometimes and my chrome extension will lock up or not actually push the passkey through or whatever it does. Sometimes I just get annoyed and throw it wherever worked.

When they're flawless they're awesome. I don't mind the quirks right now.
> People is the plural of person but a people (singular) means a race or ethnicity.

No. It means a group of individuals. What they have in common is being invested in how the country is run and having citizenship. It does not imply anything about genetic makeup, skin colour (race is such a useless concept), or ethnicity. There is zero ambiguity about that in French.
Ask HN: Can you tell if CS interests you without getting a degree in it first?
Maybe hobby programmers just assume they will find CS fascinating, only to discover much later — after earning a degree — that CS is not really the focus of their interest in programming?
Cool site, but the AI generated image makes me nauseous.
When the manufacturer no longer offers at-cost repairs and/or support.
It’s baseless because it’s pure speculation without any evidence, or even a coherent argument for why they’d go to so much work for something they already do at much lower cost.
The new Java
In Go, you would use additional bits to identify whether the zero value is valid/present. You would not use the zero value of an integer, or other type, alone, unless the zero value truly has special meaning and can stand on its own; an uncommon case for integers, as you point out.

Unfortunately, there is no escaping the extra bits. Not a terribly big deal for a large, powerful machine with lots of memory, but might be a big deal over constrained networks. Presumably that is why proto3 tried to save on the amount of data being transferred. It adds up at Google scale. But it did eventually walk back on that idea, making the extra data opt-in.
The word "tech industry" is one of the more hilarious terms. Sure, some startup with a website and App, is "technology", but aircrafts, cars, rockets, heavy machinery (which all make heavy use of complex software, with rigorous safety constraints and which all involve ongoing academic research, as well as extremely detailed Design processes) is not "technology".

Truly one of the more grandiose terms people in the software industry use to describe themselves. Same with every single person calling themselves an engineer, something which in many countries would be illegal.
Still use. I have experience with both and enjoy Puppet more. Ansible's YAML make it too labor intensive for me. I don't mind YAML for puppet hiera data but as a (domain specific) programming language YAML is inconvenient at best. Loops/conditions/dependencies are much easier to express in puppet DSL and even trivial things like write a config and restart a service (if needed) for me easier to write in puppet.
So do I, but this is annoying because I need to have physical access to both of the keys when setting up 2FA on an account, or hope that I remember to add the backup yubikey when I get back home.
Here are some successful companies with odd-sounding names: Google, GoDaddy, Survey Monkey, Nvidia, Caterpillar, Coca-Cola
nsa.gov - they are great, 5 stars
Database Concurrency Patterns for Developers
I am currently having that experience here in Eastern Mountain California now that it's dark and winter.

It's hard to tell really if always-on high beams are now common or if SUVs + superbright beams makes it seem that way, especially given there are a lot of hills that can make any car's high beams seem on.

Still, I feel like "civility" here is breaking down and not turning off high beams may be a part of it (though I'm aware that feeling may be coloring my perceptions).
Remember last time trump got in we had murder clowns coming out of the wood work?
That's a particular scheme that might be fooled, but what's stopping someone from making a version of the same scheme that redirects to a prompt on the real site which authorizes them as a new user? I'll admit web technologies aren't my area of expertise but I have little doubt it's possible based on my interactions so far. E.g. discord allowing me to log in to a new device by scanning a QR code with my phone and clicking OK.

Ultimately the point of phishing is to attack the user instead of the technology. If the user has any control over access to their account, phishing is largely unaffected.
This is a good point, but I think it's mostly a precondition to having the luxury of the problems I was describing. If you can't even broadly agree on what is good vs bad code, your engineering org has deeper problems. You don't even need substantial agreement, just enough to identify what the genuine problem areas are, vs what's just not how someone would've written it themselves.
> They want to make their own lives easier rather than the customer's.

This right here is the crux of the matter and why I have no sympathy for the defenses of Electron. I don't care at all how easy it is for the company's developers to make something. I care that the software I get is high quality, and I'm not willing to sacrifice that so that the company can cut corners on their costs.
It is fascinating how much the Moon matters to us, yet it is largely ignored.
this is sort of tangentially related: if you're feeling like every car on the road has overly bright headlights, get your eyes checked. i've been hearing people complain about bright headlights, and noticed myself feeling really sensitive to it lately.

turns out i have a slight astigmatism, and wearing glasses when driving at night makes other cars headlights infinitely more tolerable. there's still the odd vehicle that has obnoxious headlights, but i went from most cars being intolerable to most cars being totally fine.
Huge caveat to hosting this server publicly is the codebase will accept any websocket connection to the /{connection_id} route. The author gives a small warning about implementing authentication in the README, but it essentially makes the project extremely dangerous to deploy as any person can use your domain to host their content.
I agree that it's not challenging. I'm just saying that even if someone is intimidated by doing this, it's still probably a relatively inexpensive option even when you include hiring an electrician.
I studied physics in college, my one regret is I never took a compilers class but that reminds me to go down to the student services office downstairs and sign up for one.
>A fair number of sites hosted and operated outside the European Union reacted to GDPR by instituting blocks of EU users, many returning HTTP 451.

My outlook on doing this is that this is not the way to do it because these things exist:

- EU citizens living in non-EU countries (isn't GDPR supposed to apply EU citizens worldwide?)

- EU citizens using VPN with exit node to/IP address spoofing a non-EU country

Either comply with GDPR or just don't exist, period.
It is in the Southeast at least for about 90% of cases
> this initiative is part of a broader strategy to reduce reliance on foreign wireless communication technologies

That’s the propaganda line. Really this is about using China’s large population and manufacturing base to supplant western technology and standards. The linked reuters article mentions they’re promoting it in Japan and BRICS nation. Another campaign in the soft power war.
Cool! I've coded for the Gameboy Advance in the past, it's very fun to write software for well-documented and feature-rich hardware that also have rock solid debugging tools.

By picking the DS, the author might also have ensured his application will work hundreds of years from now...
This touches on the subtle but significant distinction between computer science (CS) as an academic field and programming as a skill or profession. I would say that not all paths to programming emanate from CS. But, practically, I'd say most people who get a degree in CS are not destined to work abstractly for life. Why does this matter to you? Are you worried about committing to a CS degree as a hobbyist programmer?
There's a difference between production cost and sale price. The latter is the one being referred to by the GP. The article itself is about neither: it talks about software freedom, not monetary cost.
Nice how he whipped out the attestation threat when contradicted. Shows their authoritarian leanings.
California basically sets the standards that all automakers follow for cars sold in the USA. If they can't sell a car in California that basically makes it impossible for them to make money.

California is so fond of regulating everything I hope they take this on. But whether it's California, or the Feds/DOT, someone needs to act. Headlight brightness is out of control.
Ozempic increases risk of debilitating eye condition: studies
Multinational antitrust is the issue here. I probably see this as also requiring antitrust approval outside of Japan and there is no way foreign regulators will allow that.
This is a seriously well-designed tutorial. There were several times that the instructions anticipated exactly what mistake I was about to make - clearly a lot of work and testing has gone into this.
Sonnet 3.5 v2 was released in October. Most people just use this. First and only one that can do passable front end as well.
I disagree. If I'm reading a guide on how to set up say on on-prem enterprise password manager, I don't want it to explain what "files", "network paths", and "LDAP" is. If you can't understand the document, it means you are missing prerequisite knowledge and it's not everyone's job to get you up to speed on that. Assumptions have to be made for documentation to be usable for its intended audience.
Ah, typo. A proper ffi of course
Digital technologies help increase productivity and reduce agricultural impacts
But in 2025 the law will change. It is this reason that the site will shut down the day before the law comes in.
Because your headlights are too bright.
Being able to revoke individual credentials is definitely a benefit. I'm not convinced about the transitivity, what's stopping one access from authorizing more? I suppose that would be asy to flag in an audit? Either way it's not really resisting the phishing, that's moreso resisting abuse once the credentials are gathered in any way.
You don't: firmware should always be available. I have too many repairable devices which are actually dead because I can't replace a blown microcontroller since the firmware isn't available.
This is, IMO the kind of "Accelerationism" that I can get behind :)

System is broken, therefore let's make it 100% obvious that it's broken, so it can be totally rebuilt.
It shouldn't be amazing but it is endlessly surprising to me that authorities cannot stop abusing their authority to spy on their fellow citizens. The articles doesn't clarify whether this is a case of "shootings are happening right now and we are spying on the reporters for a day or two because there is an urgent need to protect people and maybe their sources will help us", or whether it was "we were irritated that they figured some things out, it was an easy lazy way to try to find out who was giving them info".

Authorities will spy on us when given the opportunity for expediency. With everyone carrying around phone/tracking device, your recent vintage car comes with one and then there are just things like tagging devices, apple tags etc.

What we need are serious penalties for this spying, but ha ha we are going in the opposite direction. I'm not even in the UK, but I figure authorities in the US are doing this kind of thing too. They try to get text messages, all kinds of surveilance is going on.
I agree that absolute numbers are a bit strange, but the article states exactly which model of memory was used, namely a W-NM56S508G SODIMM for DDR5 and a KF432C16BB/4 DIMM for DDR4, not to mention the most important part is measuring their different performance between generations
> how much work is “in general” doing when you talk about the access Io Microsoft services granted by the PIN + TPM?

I mean you can't just go to microsoft.com and log in knowing only my pin on a single device. If you know my PIN for a device, but you don't have the device, you don't have access to my Microsoft account at all.