skysight-inc/HackerNews huggingface dataset:
Ask HN: Create embeddings efficiently for an AI notes app with E2EE
Hi,

I am building a notes application that automatically finds related notes - thinkdeli.com. I want to implement end-to-end encryption sometime soon.

To find related notes, I create embeddings, add them to an index, and find the nearest neighbors.

I am creating embeddings of the user's notes locally using transformers.js. But setting up the pipeline takes up a lot of memory (around 400+ MB on Chrome). This makes it somewhat impractical to use on older devices.

Is there a more efficient way to create embeddings locally?

Creating embeddings via an API will be more efficient, but that would mean sending users unencrypted notes over the cloud to the service.
Edit - What I mean is this. The user's notes must be unencrypted and readable as plain text on the server to create embeddings. This defeats the purpose of end-to-end encryption.

I would appreciate any pointers. Thanks a lot!
> Your ideology will murder us all, each one at a time, until none of us are left.

I am curious, what do you think my ideology is? I just wanted to understand how I came across.
This is close to what I do sometimes (and I should be more disciplined about doing it all the time, TBH). I'll often read a non-fiction book once, at a leisurely pace, no notes or anything. Maybe I'll stick a few page flags in to highlight things that really stand out to me. Later, if I deem it worthwhile, I'l re-read the book and take notes. After that, I'll re-read my notes and try to consolidate my thinking and distill out the most important elements into a separate notes document. And on rare occasions, I may later re-read the original book a third time and refine my notes even further. If I'm reading a group of books on a related topic, I may open a new document and then read/re-read my earlier notes on each book, and put the synthesis into the new doc.

The biggest problem with all of this is simply that it's very time consuming. But when doing a pointed, intentional "deep dive" into something specific, I've found it to be effective.
I have a similar experience, where I was originally denied a refund I was entitled to per EU’s passenger’s rights regulation (261/2004) and reported it to the national ombudsman for consumer rights and having them agree to pay up immediately.

This was also a budget airline (Norwegian). I’m pretty sure they’re trying to deny claims as a rule. They were making an excuse that isn’t a valid force majeure (the airplane needed emergency servicing).

My experience with Scandinavian has been the exact opposite, I pretty much just inform them of which flight I was on and that I’m interested in compensation and that’s it. Though this was pre-COVID and reconstruction.
I would upvote you tenfold, if I could.

Everybody needs to find some meaning in their lives. If there is none, you already know how it ends, and however you might try you will not change this ending.

In the past, people would find this meaning in religion, but these days seem mostly gone. Finding things you like and doing them seems like a good strategy but not bulletproof. But being a part of a community and contributing to it may work miracles. You can really feel you can impact other people's lives in a concrete, meaningful way, and it can give much deeper satisfaction than a good game, movie or meal.
I have an esp8266 hooked up to a solar inverter. it used to have problems with not getting enough power so i hooked up a power bank between the inverter and the esp. if the power from solar gets out, the power bank (10k mah on paper, must be less) can run it for around 36 hours on full charge.
Thank you very much. I feel like engineering innovation has been concentrated on technology and not in defense engineering at all.

Immigrants have helped a lot in building the tech sector's innovation in the last half of the century. But the defense industry often requires naturalized citizens to work on these projects. I think there is a difference between immigrants coming to North America to work and eventually settling down, and offshoring work outside of North America. Immigrants cannot work in the defense sector while private companies are more than glad to have them work on their projects. The challenge is that the current framework for innovation may not qualify for the defense industry.

In the pre-Cold War era, the concept of American innovation was largely fueled by industrialization and academic participation in government sectors. Post-2000s, I feel like American innovation is rooted in the idea of diversity and America's ability to bring talent from across the world and concentrate it in major cities.

My thesis is that the US wants one or two American companies with monopolistic nature to build their future defense sector.
Thank you! Glad that it fits your needs!

I've investigated the error and made the description required for now, hope that works for you!
> Everyday expenses and housing costs, including rent and mortgage payments, are the biggest reasons why people are unable to save for retirement.

That’s one lens to look through. A different looking glass will show you that the individual is choosing to live beyond their means. Or slightly more generously, not choosing to course correct the direction their ship is sailing in.
In US those are essentially equivellent as money buys soft power very easily. This whole thing is US not wanting to expand user rights but protect it's soft power and it shows.

I think either way this whole thing is a big W for CCP and L to US democracy that doesn't have the balls to actually expand regulation when it's clearly wanted and needed.
> and correctly refusing to censor speech outside of Australian jurisdiction.

Speech?

Regardless of any stance here on the matter the Australian Government isn't asking to censor any speech .. they want to dampen down the glorification of violent acts by asking social media to not carry the video of the stabbing.

You can write paragraphs about the event, transcribe what was said, the speech part isn't being asked to be censored here.

On the second point, coordinated five eyes actions requiring oversight from citizens of all countries involved and being kept in check is one thing; using the statements of Senator Jacqui Lambie (a fringe member of a finge political party (Clive Palmer, the Vogon offspring of Jabba the Hutt)) as representitive of Australian policy makes as much sense as taking Senator Ted Cruz a spokesperson for the USofA.

Pragmatically spies and cops might want encryption with backdoors, practically they're unlikely to get this .. "even in Australia".
Most of the entire field of machine learning is “try shit and see what works”. So it seems like they’re par for the course.
it doesn't. never prevents reading and readonly prevents (over)writing.

GP just focused on the never-part of your question.
Why wait until TikTok breaks the law to ban them? Banning an app after it’s been used for nefarious reasons to either spread propaganda or incite chaos in the upcoming elections is too late. It’s like saying “let’s not patch a zero day we found because no one has abused it”.

TikTok being owner by Bytedance means you don’t have who to prosecute for misdeeds, besides some fall guy.
True. Talking to myself there in that last line. I gotta get out of the house more. I wasn't trying to be preachy, but now I will.

Please find Christ and oppress others with his teachings. I wasn't very religious, but the Jefferson Bible is pretty dope. Jesus was a pretty cool dude. He like forgave people and stuff. https://en.m.wikipedia.org/wiki/Jefferson_Bible
Existence of mental illness or troubles makes me doubt that.

What is free will when you are suffering from pathological procrastination, depression or addiction ?

If you accept the fact that, like in addictions, your brain chemistry makes you smoke cigarettes or drink alcohol even when you know you’ll die from it and know it makes you miserable then how can you be convinced that you really control your normal behaviors ?

Why does anxiety makes me stay in my couch and antidepressants makes me want to go outside ?

I understand free will as a moral concept but at a biological level, i feel like it adds a lot of shaming and suffering to people who struggle to modify their behavior because science now knows that changing behavior is hard and impossible without physical modification of the brain structure.
Capitalizing one and not the others is racist. There is no monolithic white, black, or brown experience, and to pretend otherwise is racist. It's a stupid microaggression
No, and since I'm not really interested in mobile development, there probably never will be
>I know Americans have a similar relationship with baseball-specific words, right

It's true, there are a bunch of American idioms related to baseball. What's funny about this, however, is that baseball isn't very popular in America these days (American football and basketball are much more popular, and I think even hockey is now more popular), but baseball is actually quite popular in Japan.
It took a day to optimize the landing page, it looks pretty good
Background: When starting the Smind.App project, in order to go online quickly, the floor page is very simple. Later, the previous landing page of user feedback was too simple to introduce the function of Smind project!

Okay, since this is the case!Then take action

It took a day to optimize the landing page, and it looks pretty good ~
Mainly introduced the functions of our products and optimized some details. Now it looks much better. Of course, we will continue to optimize!In addition, we have lowered the price of the product a lot. Mainly, in the early days, we thought more users could use our products, not because of the price, of course, most of the functions were free!
Finally, take a look at our products：https://www.smind.app
> If novelty in music is actually important to you, this won't happen to you.

Assuming what's "actually important to you" remains fixed as you age. The article suggests otherwise, with caveats:

> At the same time, stagnation is not a certainty. Research suggests that open-eardness and the discovery of new songs can be cultivated. Finding new music is a challenge, but it is achievable with dedicated time and effort.
> Ukraine, is a rising democracy and is still here.

Man! At what cost? Someone who used to work with me with sent me a pic - writing code from a bomb shelter.

Add:

> Neither the Nazis, nor the their Soviet allies could destroy my family.

They may not have destroyed yours, but they did destroy millions of other families.
> FWIW, the missing element in this framing is real, substantive community. Not conversational or ephemeral community like you find online, but the kind of substantive community that engenders a network of mutual support.

This is one aspect of US' stereotypical work culture that always caught my attention: the way that work permeates in employees' personal lives.

Now I'm starting to see it the other way around: a lot of people simply do not have a social life, and work is used to fill that gap.

That would also explain chronic overworking. Why would anyone want to leave their job at 5PM when all they can do is be alone with their lonely thoughts? At least back at work they have people who are contractually forced to acknowledge their existence.

A few years ago someone told me a former team member of theirs committed suicide in the office, and was found the next day by other employees hanging from the ceiling. I couldn't understand why anyone would do such a thing, and specially at their workplace. Perhaps that was the only place they had in their lives and where they knew someone they knew would find them. Also a few years ago, when I switch jobs the first piece of office gossip I was told was how an employee tried to commit suicide by jumping off the building once he heard the news he was being fired.

Your career in general and your job in particular plays a critical role in your life, but if that's all you have then you are an economic downturn away from finding yourself at the bottom of a very deep pit.
Optionality, even for a monopsony like the Defense industry, is good for the consumer (Pentagon). They still want suppliers to compete.

What incentive is there for a company to innovate if the DoD allows their competitors to die out? When it's time to buy a new fighter jet (or whatever else) those acquisitions chiefs want several options, same as any consumer.

The OUSD for Acquisition & Sustainment publishes lengthy analyses on competition within the industry and how to stoke it. [0]

[0] https://media.defense.gov/2022/Feb/15/2002939087/-1/-1/1/STA...
Assuming the converse is really putting Descartes in front of the horse.
The reason for this seems to be

1) extended depth of field with a smaller pupil in bright sunlight (smaller aperture) that keeps objects at a wider range in focus

2) biochemical cascade responding to certain wavelengths in sunlight that produce a “stop growth” signal in the retina
> We already have quite a lot to exploit in the region around us.

I don't disagree.

> We assume we understand our future wants, needs, costs, and capabilities. (Granted, any future thinking is also subject to this, including my own.)

Even if 99.99% of people are content with what the solar system has to offer, there will still be billions left to go and explore and settle outside for whatever needs and reasons they have. Even if those needs are imagined, or the reasons might be purely ideological or religious.

> But I think that assuming we'll want to send lots of entities vast distances in space and time might be a lot like thinking we'll have flying cars.

If only a tiny fraction of people will _want_ this, that's enough.
Mind Mapping online simple and convenient to use
This FT long piece on Palmer Lucky, and Anduril has some good context: https://www.ft.com/content/ce6f96f8-6ab8-4089-b7db-f99db22c2...
AI could kill call centres, says Tata Consultancy Services head
https://on.ft.com/3Uhznrs

AI could kill call centres, says Tata Consultancy Services head

Chatbots will soon take over much of the work of human agents, forecasts chief of Indian IT group

I read the article to see if TCS was offering more than “we prefer to get paid for high end AI engineering work rather than low end call center work.”

The more I was looking for was an understanding that paying customers reward good service by buying premium services. We are receptive to an upsell if the company offered a useful service when we called them. Whether the service was delivered by a robot or a human is less interesting to a customer.

It could be that TCS did not understand this or they did and the journalist buried the lede.

Having read the article, my take is that TCS is simply saying “we prefer to get paid for high end AI engineering work rather than low end call center work.”

If you’re not an FT subscriber, hopefully someone will post a free link. It is not worth subscribing to get this PR piece.
Actually looks really nice for the price, but I don't think it does support nbase-t.
I’m similarly weird. I grew up in the 90s and listened to a lot of grunge when I was 14 (the music age we seem to prefer according to the article). But I can barely listen to the music from that time anymore. It just sounds so dated, maybe because I listened to it too much? Something like Pearl Jam or Soundgarden just sounds so dreadful now.

Instead, music has become much more timeless for me. 50/60ies jazz, 70s prog rock, Bowie, 2010s hiphop, it’s really all over the place.
Black isn't an ethnic group either. There are black people from Africa, Pacific islands, Australia, South America, and India. It's a descriptor, not an immutable category that defines you, and it's uniquely used here in America.
> Hrm? When I think of things I tend to see multiple possibilities at once, and then decide which I think is the most reasonable, and go from there.

And based on what do you decide ? Probably your past experience, your knowledge, your education and your moral values. Which are all somehow environmental factors.
In china in 2018, 17% completed tertiary education. If you're comparing the worth of society by tertiary educational achievement, than Canada is beating America and crushing China. I already said that Americans educational achievements are mediocre relative to the rest of the OECD. However I'd bet money that its PISA scores would hold up next to China's if China actually tested the same percentage of the population that America did.

One country has borderline racist MAGA slogans. The other has Han Chauvinism and forced propaganda for a totalitarian state. There's plenty of conspiracy theories and misinformation in both countries. Here's a study showing that 13.8% of people in China considered GMO foods as a form of bioterrorism targeted at China[1].

I'm not saying America doesn't have problems, but most of the criticisms you lobbed at America can just as easily be lobbed at China, and yet China seems to be economically expanding rather rapidly relative to America or most places. I'll also say being highly educated isn't all roses, every country with tertiary education levels as high or higher than Canada's has a well sub-replacement birthrate - the education levels you idealise aren't even independantly sustainable.

[1]https://www.nature.com/articles/s41538-018-0018-4
> How about China stop being an adversary and allow US companies to settle in their country without needing a chinese owner and having its IPs stolen

AFAIK china requirements are mostly about censorship and using chinese datacenters

> China has been doing that for years

China has been doing many things I would like the US to not start doing... Let's say that the US could find better role models
Poor Hashicorp
You are correct, it’s mentioned in the article:

> Buttigieg reiterated that refund requirements are already the standard for airlines, but the new DOT rules hold the airlines to account and makes sure passengers get the "refunds that are owed to them."
Can’t wait to buy every Australian’s Medicare and Tax Office filing data on the dark web.
LOL, I feel like the author mix up the two things even in the title. There are HTML attributes, there is the DOM API (which for example exists also in other languages, but not always refers to HTML but mostly XML instead) and there are JavaScript Object properties. And because the DOM api uses JavaScript objects you can access properties. But only attributes are serialized / deserialised. And some frameworks blur this, so you get and set both as a „convenience“.
The amount of possibilities you see might be influenced by your emotional state, and what you call "reasonable" might not be the same thing as other people consider it.

A lot of our reasoning are applications of observations and best practices rules that we are sometimes not really aware of unless challenged by circumstances or outsiders.

This is to some degree necessary - the outside world is too complex to fully model inside our minds. The most important things that we can only build approximate models about are other people.
What we are seeing with VC driven "innovation", is only going to get worse when the Linux/BSD founders generation is gone.
A combination of Notion and notecard system that I first learnt from Ryan Holiday has been my go to method for this.

Tons of other successful people in the history have used the notecard system to create a commonplace book.

What I'm not a fan of is people spending hours on setting up these productivity systems
https://stackoverflow.com/questions/190771/how-secure-is-sen...
I'd argue that for european users, handing over a huge amount of data to american social networks with their lack of privacy protection is also highly problematic.

Perhaps the EU should do something similar to Facebook, X etc.?
US can easily use the free trade as the ground to ban TikTok, instead it uses an subpar excuses that often used by CCP. This shows how incompetent and how bad current US leadership is in term of understanding what makes US to a the most powerful country in the first place.
Then you agree that it does not prove your point, its just another fact like "Today is Thursday" :)
All this coming to light because X and Elon’s leadership didn’t bend the knee to them and said no we support the free speech. Gotta love the difference one person can make. All the other social media companies have complied with their requests.
Well, let's see, I had met with my boss, I met with my boss's boss, who was also the CEO, I met with my boss and the CEO, I met with my boss and the CEO and the cofounder. I wrote emails and had hallway chats and met in person. I asked, asked again, more formally outlined the situation, pleaded, asked for an update, and then said they weren't leaving me a lot of options.

Throughout this period they kept promising they were trying to hire but I hadn't seen a single resume or interview.

Most jobs, I'd just bounce and leave 'em hanging at that point. But, I actually liked most of the people I worked with, they just had a terrible CEO that had a bad habit of seeing devs strictly as cost centers. I wanted them to fix it, and this was an appropriate move for that company and the company's culture.

Thanks for your judgement though, wish you'd been there to tell me how to be better.
>I see this as a national security threat that it is.

The US government is a far greater danger to the average American than the Chinese government is, and this bill just gives even more power to the US government to dominate its citizens.
Java supports the never free strategy with Epsilon GC
Absolutely. Trump proposed banning TikTok during his term and he was laughed at. As I said in another comment this is censorship (and Chinese style protectionism) being disguised as national security.

Even if there were efforts to ban TikTok before that time, this obviously escalated it.
I was there and saw it happen.

This is way before mmorpgs, mass online multiplayer and consoles mostly completely took over.

It killed the culture. But of course as we know, gaming is now a billion dollar industry so maybe it was the gamers that had it right all along.
Musk has already alluded to bringing back Vine, so the eradication of TikTok would be no great loss.

As an aside, I always viewed TikTok as a real world analogue to the mind control subplot from Zoolander (Frankie says 'relax')...
I've been in yours and it's wrong.
I understand what you mean, and this is one of the many reasons we all feign great surprise at this news and others. However, an undesirable or uncomfortable reality doesn't make it any less real.

And, even if you take the popular position that objectively extraordinary Jewish achievements are all due to education- see for example here: [1] - the bottom line doesn't change- there are more higher achievers in the Jewish population.

Nitpick: note that I'm not attributing anything to you, that would surely be racist. Every individual is different and needs to be judged on his or her own merits. Also, the Mein Kampf guy is the other one :)

[1] https://www.thejc.com/lets-talk/why-are-there-so-many-jewish...
> How do you prove that something is both true and false

By displaying two different trees, both well-formed with respect to (nodes from and leaves that are axioms of) the logic, one of which shows that the thing is true and the other which shows it false.

(we don't usually care about this possibility because if we take care to use consistent logics, whenever we have two proofs P and Q with truth values V and W respectively, then V=W)
You can be refunded without receiving additional compensation.
Are all of your comments devoid of content, or just this one?
so always use getProperty instead of getAttribute to avoid surprises?
This isn’t Reddit. Furthermore the trend of comments is the exact opposite as what I see on every other thread regarding this TikTok ban.
If you liked the D1 Mini, you can now get the excellent S2 Mini with an ESP32 S2 microcontroller for $2.50 on eBay. I just ordered a 10-pack for my HomeKit projects.

https://www.wemos.cc/en/latest/s2/s2_mini.html