skysight-inc/HackerNews huggingface dataset:
Ask HN: Are there tools that disentangles representations in unstructured data?
Hey HN,

I'm a student at Harvard that is working in lab on a project in the area of disentangling representations, and I was wondering if there are open source tools that act as a sort of data layer in your pipeline, building useful downstream representations that your models can be trained on and used for a wider variety of tasks?

I know in the past tools like DeepDive from stanford worked on structuring unstructured data, but they really focused on making data tabular. Most data in the world can probably be split into more useful representations than that. Am I mistaken in any of my thoughts/assumptions?
Even just "more relaxed" waiting staff would result in better relationships with customers, resulting in better tips and more returning customers.

Again, this could only be (dis)proven in a large-numbers experiment (so no, not in a single cafe :)), but I don't think this is limited to any one particular area of work.
You list an amazing number of apps and services, but that doesn't seem to reassure me of the idea of giving up your credentials.

That's way too much enthusiasm for the new and shiny app, way too little awareness that in this world people are out to get what's yours, way too little concern for questionable security at every single layer of computing, way too much trust in the banking system, way too careless about the information about you that you give to strangers.

Not something that people I know who are good with money would do.
A group declares themselves a charity, gets a foolish government to go along with it, and suddenly they deserve, for free, the money that other people worked for? Okay...

Believe it or not, some people see through this rather obvious scam.
Where is the link to buy a custom picture frame using the palette???
Wow, this description is eerily similar to my own history and current situation - only real difference is a focus on Azure rather than AWS!

I've always been a strong believer in being a generalist - at least in my experience, the best developers and architects have some knowledge of networking, Windows, Linux, security etc. Basically, they know enough that they can quickly get to grips with almost anything that's thrown at them.
Cashless means lack of tracking. Naturally, a surveillance state wants a non-cash society.
> JavaScript is strongly sandboxed and has a pretty good permissions system

We now live in a post-Spectre world. I don't think a sandbox means all it meant in 2017.
This is accurate. Age discrimination is rampant in tech because young people are essentially recruited as unwitting scabs against their older peers. Aside from depressing wages and increasing loyalty (via fear of precarity), it’s also a very effective way to fight unionization, which software desperately needs (not for compensation reasons, although that will change, but for professional and ethical reasons).

It’s easy to impress a 24 year-old with a decent salary, a stocked kitchen, and lots of dumb little perks they can brag about (never mind that they are being paid, sometimes literally, in peanuts). They don’t start thinking about job security and labor power until it’s too late.
So what, $20 per violation? How is that even a punishment? They could have made more than that just on interest payments on their ill-gotten funds.
> I’m not sure about Brazil, but in general it is very difficult to compare a developed country with a developing one.

The context for Brazil is mostly that it is a democracy from 1888 til nowadays, but with a shadow institutional period from the 60´s to the mid-eighties.

So the country had to rebuild it´s own institutions from the eighties til now, to serve a democracy instead of serving the wills of a dictatorship.

Now, its in a point of testing its institutional maturity, and the rule of law, by the ongoing crackdown on corruption and organized crime. A lot of big political figures from all sides (and executives) are in jail right now, and theres a current crackdown going on in the organized crime front.

But the big test right now is the current Brazilian government with its backwards policy. Will the organized institutions from the society, and the other powers besides the executive able to make a stand against going backwards?

Theres a big test going on in Brazil right now, if 'we' are able to pass this dangerous phase and still have the democratic institutions and balances in one piece, than i guess it will probably move foward and get stronger with time.

In this sense also, the US was lucky to have England as a cultural parent, because England was/is great in making solid institutions. From government to the academy.

The colonization process of the countries colonized by the spanish and the portugueses, were mostly a vampire-like kind of relation. Where they took everything they could, leaving a trail of exploitation and slavery behind.

The portuguese colonizers even used to forbid Brazil of the colonial/empire era to have a University, which we only manage to create the first one here in the 20´s.

Anyway, i guess the answer to the rule of law, is both; is "good enough for most things", and "we are getting there". Not something to be proud of, not something very advanced, but not bad either..
That would work for some kinds of work.

But I live to work, and often work 7 days.

I can't imagine doing a project with delivery time pressure (like a startup trying to execute in a timely manner), working only 4 days, with a 3-day gap.

I'd rather have flexible hours, and an emphasis on working sharp in the hours we do put in -- not have frequent 3-day interruptions of project mental space, and putting off gratification in seeing the project come together.
Most doctors are probably intellectually aware of the concept/possibility... but powerless to influence anything because a) we don't have usable genetic information available on people, and b) we don't routinely have information on the impact of different genetics on drugs.
This is what happens when senior management gets overpopulated with corporate robots rather than characters with imagination. Fear and avoidance of anything unknown drives decision making.

I just can't understand how they plan to inspire Hope and Faith in the future with one retarded timid decision after another. It's like they are scared to lead and want to turn into another irrelevant IBM or HP.

It's not complicated to deal with these kind of robotic decision makers especially in a company that claims to be creative. I hope something shakes and wakes them up soon.
Age is a proxy in people’s minds for other things, usually maturity, gravitas and playing the social game. Not always but more often than not. Age is a quick if inexact proxy but you can prove it in other ways.
Do people want it to be easier to break the law? I don’t understand.

This reminds me of the commenters defending the would-be car thief on the Amazon Ring video yesterday.
Oh yeah, in the city you might have a point. I was picturing a limited-access road in a suburb, with lights spaced pretty far apart.

https://en.wikipedia.org/wiki/Limited-access_road
The cycle is entirely up to the local Department of Transportation be it a city, town or state. Where I live we have short cycle lights at heavy intersections and long cycle lights at intersections where keeping the primary/heavy road going longer is 100000% more worth it than some side secondary road with 3 cars every hour.
There are also plenty of complex areas where all the lights on a road are interconnected for miles and the timing is set to match between them to more efficiently feed cars onto highways and move them along.
Obvious way to do this would be with some variation of ranking the edit distance or simple entropy differences, and alerting/prioritizing significant updates for further scrutiny in another workflow pipeline. Bug fixes are relatively low distace, where a new module would show up as a bump. It would FP on code cleanups, but who actually does those. There are more sophisticated methods than these used in products today, but this is something an amateur could implement. Compute is huge, but cost/benefit is a product problem.

Some string searches would be easy wins as well, given wallet file names, detecting new public keys, etc. Can think of a few AV products that would benefit users by being able to state an app has added an update that resembles a new module with functionality they might not have signed up for in the original EULA.

If you are an enterprise customer, I'd ask your AV vendor for it as a feature. Realistically, the best control is don't put a cryptocurrency wallet on a device that has automatic updates from untrusted sources.
I actually see a parallel between this and the Boeing Max issue.

Management's job is to make money. Since they don't actually do the work, they have a limited number of options for doing that. And they are not judged on the quality of the work, since someone else did it, only how much money the company makes.

They need people to watch the station. So they came to the conclusion that ratings would increase if they created a sense of emergency. Even if it's a totally false emergency. This is actually a public safety issue, because it means that viewers may not be able to determine when there is an actual emergency.

In the case of Boeing, the pressure to make more money caused executives to decide to implement a half-assed upgrade rather than do the new design work and have to recertify the safety of the new plane.

It seems that the pressure to increase profits frequently overrides integrity. I don't know how you're going to change that, because executives are only rewarded for making more money, not for integrity or anything else.

One option would be to place these executives in prison for endangering public safety. That's not going to resolve the core structural issue of profit conflicting with safety.
> People need to take responsibility at some point.

Such as by enacting environmental laws.

Advocating for boycotts as the only course of action is equivalent to letting the behavior continue, because they hardly ever work. If you want results, you need collective action - i.e. laws.
I'm sure the actions of a person who would buy and set up a specialized device to block ads are not representative of the general population so I (and probably any other content producer) are not going to optimize for that use-case, though I do appreciate your sharing.
this has to be viewed in the overall context of employment law and its purpose in society. we have anti discrimination laws not because the government is trying to give each and every corporation all the fuel it needs to become devilishly efficient. we have anti discrimination laws to increase equality and create a more even distribution of wealth and opportunity despite disadvantages imposed upon applicants by circumstance.

also, the government can be viewed as having an interest in keeping people employed in general so that they do not become dependent upon government for sustenance.
Let's start with the assumption that you have people with money. Let's even suppose that they're probably the people who end up in power. If you have a limited government, they don't have much power.

If you have a federal government with the power that the US government had before 1930, you don't have as much money being spent on campaigning and lobbying, because the influence isn't worth as much, because the government can't do as much.

Back to your comment that I was replying to. What I meant was, with a limited government, if the bottom 90% of the people want to take all that the top 10% have, if "taking all that the rich have" isn't one of the things that the government is allowed to do, then the 90% can't do that. ("Allowed" in the previous sentence means "allowed by the constitution", not "allowed by the people in charge".) In a country actually ruled by law, there are genuine restrictions on what the government can do...

... until there aren't. The US Constitution can be amended. It was amended to allow for income tax, for example. If the 90% wanted it badly enough, they could probably get it, but it would take more than just yelling at their representatives. They'd have to actually go through the process.

Then there's the problem that you seem to be talking about in your reply, that the representatives tend to be from among the rich. That puts another obstacle on the peoples' ability to just take what the rich have...

... until the people get tired of it all, take over the streets, and just burn it all down.
That's so far beyond a symptom of a severely broken system, I find myself thinking. And it's obviously super sad.
OSGi is what killed Eclipse. Instead of focusing on producing a fast, modern IDE, Eclipse became a design-by-committee monster that had to support just about any use case on the client.
IMF warns of giant tech firms' dominance
Why would they block you from downloading windows if you're already on windows?

For what it's worth, I successfully downloaded that windows iso from microsoft less than a week ago from a windows machine, and used it to reformat that same machine without any issues or workarounds.
It was a bit, but only about 1/3 ended up with an onsite.

Part of the reason is because I hadn't spent as much effort on this earlier in my career; now with the concern of agism, every time I'm on the market I try to level up my skillset.
Noisebridge is a non-profit, whereas Techshop was a for-profit corporation.
That is really an indictment of the sorry state of PC trackpads. When I use my partner's MacBook with its pixel-perfect, glass trackpad, I never feel wanting a touchscreen.
It's the easiest way to get all platforms (Windows, Mac, Linux) if you're already comfortable with web dev.
That’s an interesting jump to make. I’ve never heard any one say that’s the way to go. You’d have to have a 99.99% extremist view to be serious about no families.

They likely mean what is the more obvious assumption. We take taking care of all children as a serious problem and try to have certain benefits happen for all children. IE they shouldn’t be going hungry or not going to school.
> to continue to make progress,

or they fall for the money-making scam, where their new car payment is now the same amount as their rent originally was when they began their careers. Buying larger houses, etc. Basically always barely acclimating to their new level of wealth, so that they always try to climb up the next rung.

I recently quit a job that was advertised as a developer but turned into 90% paperwork. Lasted over a year (it was contractor anyway). But in hindsight, basically NO amount of money would make me happy or willing to fill out forms all day. Seriously, even another $100k wouldn't make me feel any better, I'd still be miserable and not doing what I love.
Another candidate for antitrust action?
Seconded (as a European). I also found the cycles in the US very long, they are optimized for batch throughput, but do not take human nature into account. I noticed people are much more likely to keep driving when the light turns yellow and then red, than in Europe — probably because they expect a long wait if they miss the light. This is especially dangerous to pedestrians and bikers.

Removing the traffic cameras seems like a bizarre move: if anything, I'd place more of them, with more severe penalties.
I'm sure it's an oversimplification of the description of the protocol. For example Apple could use a "base private key" that's just a seed fed to a CSPRNG to generate a series of EC private keys. The client can then rotate through this series of keys, while the "base private key" never changes.
No, not at all

At best Politico is "leans left": https://mediabiasfactcheck.com/politico/

Breitbart is on par with Stormfront
Why does this photonic chip only work as neural networks? What stops this technology from being made into a photonic CPU?
Can anyone tell me if this is felt all over specifically in areas like the midwest or the south? Or does this problem happen mainly in the weird zones of silicon valley and NYC?
I posted this a couple of days ago, but I guess at the wrong time of day - when I saw it got no interest, I thought "I'll bet this is one of those articles that someone else posts later, that the mods let through"!

This comment is a bit meta, but I actually really like this "second chance" feature of hacker news. Mods could in theory "boost" such stories by making them sticky, but I like this kind of hands-off, no-meddling approach :)
It's very convenient. But also very expensive (maybe)
The raw costs of getting an AISP licence are about £1000 in the UK... but that's ignoring all of the time and effort to understand PDS2, legals etc but $500+/month for Plaid to do it for you ? I'm not sure. Sounds avoidable like vendor lock in to me.
Tariffs wont be paid for by Mexico in any case, they'll be passed on to the US consumers
Ok, now substitute 'humans' for 'chickens', 'children' for 'animals' etc and re-read what you just wrote.
Why can't you decouple teams form each other with modularity and encapsulation? I never worked in a team, but I could imagine that teams just have some agreements about interfaces and then work independently on a single code base but in a different classes and packages.
My sense in Los Angeles is that traffic laws mostly go unenforced. This allows persistent, continuous safety hazards for pedestrians and compliant drivers.

We have a situation where running stop signs and red lights, speeding, reckless driving and gridlocking behaviors are rewarded and very, very rarely penalized. State laws require revenue from traffic violations to flow to the state of California rather than to the locality so the LAPD's incentive to spend costly officer time on traffic enforcement is quite weak.

IMHO, in Los Angeles, automated enforcement measures would be worthwhile.
r/machinelearning
Hard to argue that the ease of use of public cloud data solutions isn't having some effect. There are ways out - like truly functioning identically on-prem and multiple clouds but it's challenging.
Teams is equally horrible.
The article misses an important bit of info: when the construction started, the Sagrada Familia was not in Barcelona, but in an independent municipality, Sant Martí de Provençals. It was to this municipality that the building permit was requested, not to Barcelona, which would annex the municipality and with it, the Sagrada Familia, 15 years later. Plus, most of the documentation regarding the building, including plans, scale models etc. were destroyed in a fire caused by anarchists when the Civil War started. The story is more complex than just incompetent bureaucracy.
Its the American way.
Please! http://its-not-its.info/ Why is it so easy for nth language learners and so annoying to read.

Edit: guessing by the downvotes it's just me being annoyed by it. Well, sorry HN. Seeing as it's so hated to be annoyed by it's and its, should I make some public apology or something?
> 20-year-old project managers don't have a clue

maybe the company should have had policies that gave their managers more clues?

> he sells air-conditioning now.

probably makes more (and accomplishes more) than many engineers, especially ones at vapor-ware startups.
Yes. China. I love WeChat I must say. Much better than WhatsApp.

Yes, Tiananmen Square. Westerners in China call it "The day when nothing happened". But I also heard different views from Western Politicians that were deeply involved with the Chinese system. The amazing thing is that the students were actually allowed to protest for a long time.

The guy in the video is just an asshole. He is harassing normal Chinese people who might get problems.

I love Chine. I understand and respect "sensitive" issues. In the end I can not become Chinese and always will be a "tolerated guest".
There are not yet any good (cheap, reliable, composable) optical transistors.
The problems with the JS ecosystem probably could have been solved in a way that doesn't involve every nontrivial project dynamically downloading thousands of transitive dependencies by god-knows-who. It's not like package repositories and dependency management were uncharted waters before npm came along.
That's true.

But it seems really inappropriate to say this here.

We are discussing the insidiousness of discrimination with the hope of socially being more conscious and finding ways to improve this.

It's kinda like going into a place with victims of racism and saying 'get over' and 'use your white voice/dress more white' when talking about the issue of racism. Or suggesting that racial discrimination is justified. It's out of place, even if the suggestion is coming from a good place of wanting the best for the other person.

P.S. I had a department with large numbers and strong growth on my side for leverage, that is why the CEO considered me in the first place. The numbers took a big hit after I left. If the board would have had more people in their 40s and less in their 70s-80s, I would likely have been accepted. Explaining to me that this is politics is a very pedantic in assuming I don't understand politics.
Sure. Other comments in this thread are throwing out numbers like 99% of people would chill at home with tv on all day just because of a safety net. I wasn’t sure what sort of degree you were going with things.

Of course more people would take advantage of the system, but Americans overall as a society don’t like excessive laziness and put pride in some amount of work being done. Not working and being poor is frowned upon generally. To keep things loose, this is true for at least greater than 50% of the country.
Sorry, layman here, but in what sense is a substance with a name like that "organic"? It neither sounds natural nor does it contain carbon to be called organic in the chemistry sense...
Is this in the US? The way you structure your writing makes me think you're not a native English speaker. What you could be describing is either a bias against hiring non-Americans (i.e. they should be cheap labour) or it's an issue from another country.
I wondered similar things at various points. I’m still waiting for the Ga chips the guys at Intel said were right around the corner...in 1999. My rudimentary guess is tech or manufacturing just isn’t there.
Isn't that an issue? for instance if someone made a video 'out of your domain' (e.g. different model than the interal training example) how would the model perform? Would the AUC be impacted? what is the PPV? It seems common in these results that people are experiencing false positives, i did as well. if the percentage of fake news that we read is 10% and the model (auc + operating point on a test set unpublished) has 92% sens and spec we would still expect that ~50% of model positives are true negatives. If the "accuracy" is computed in an unblanaced dataset, what is to be taken from it ?
If you used any IMAP accounts (not from Google), you would need to enter the password. And Spark will quietly send it to "the cloud" and keep it there, with servers accessing your mail whenever they please. This is kind-of mentioned in the Privacy Policy, but in a way that wasn't clear to me at all.

I found this unacceptable, so I can't use Spark, which I regret. I also lost trust for Readdle, so now, even though they make great apps, I am extra careful with handing them any sensitive information.
> "The whole breeding arena of the species needs to be cleaned the fuck up!", he is referring to "crazy" people

It's remarkable that extremism has gone so far that advocating eugenics is defended as mainstream.
For a security critical app not locking down the dependencies to audited versions seems very dangerous indeed and I believe there is some blame to be had there