skysight-inc/HackerNews huggingface dataset:
I'm conflicted; its a nice write-up, and probably generally true right now, for most stuff.

However, I still live with databases big enough to still need cubes, although these cubes can afford to be less refined these days. Saying 'bigtable can do a regex on 30M rows per second' isn't saying it can't be done cheaper and quicker without paying google etc, if you just have some cubes.

And I think its going to track the normal sine wave: over time, data sets get bigger, and we keep oscillating between needing to cube and being able to have the reporting tool 'cube on the fly' behind the scenes.

I think there's a general move not mentioned in the article as data-lakes become faster, and then data outstrips them, and so on too.

The strength will be tooling that transparently cubes-on-demand. I wish there were efficient statistics and CDC that tracked metadata so tools can say 'this mysql table has been written to since I last snapshotted something', and, even better, 'this materialized view that I have in this database is now out of date because of writes that affect the expression it is used from on that other database over there' etc. Basic classic data-sources can do a lot of new things to make downstream tools able to cache better.

I have a slight problem with the terminology in the middle of the article, as I'm so far down the rabbit-hole that I think of cubes _as_ databases; I suffer cognitive dissonance when I read about shifts from cubes to databases etc. To me, a cube is just a fancy term for a table/view for a particular use-case.

One tool that I'm terribly excited about these days is presto. https://prestosql.io/ allows you to take a constellation of different normal databases and query them as though they were one big database. And you can just keep on adding data-sources. Awesome!
In a world where legendary producers like Madlib are creating sample-heavy, layered production on an iPad, who's really "creating" stuff?

https://genius.com/a/madlib-says-he-made-all-the-beats-for-b...
Sorry, I worded that badly.

We used to use a locally-hosted ELK stack, so yes, including ES as the data backend for Kibana, but there Logstash or more precisely filebeat and logstash-forwarder became the bottleneck. That was a horrible experience because then filebeat would keep the old (unsent, but deleted) log files open, so production servers crashed running out of HDD space even though "du -h -s /" was a lot smaller than the HDD size. It took me way too long to figure out that deleted but still open files were the problem.

So our decision to move from using ES invisibly as part of Logstash towards a full dedicated ES cluster was forced by the Logstash pipeline getting too slow.

I then evaluated Elastic Cloud and using Amazon EC2 for deploying ES, both of which were ultimately rejected. The first due to fears of data loss, the second due to costs.
You're only a Real Unix (tm) if you pay for a license.
On C language an expression which evaluates to any non-zero value is considered as True. So for example this kind of statement would not likely behave as intended:

if (TRUE == expression)
{
...
}
To emphasise: This is about Bournegol. Nothing to do with this post.

> Can you explain why?

Because it isn't how most C libraries expect true/false to be defined.

stdbool in C99 standardized things a bit, but before then what was generally accepted was:

> true is 1

> false is !true (Often 0 in practice).

Which means that any trivial:

if(true) { ... }

Won't work under Bournegol. Instead you _need_ to compare when doing an if statement.

So the C-programmer is easily tripped up. False will work as expected, but True won't... All the time. There may be times it does work. Leaving the programmer throwing their hands in the air.
But at one point, they jump between two airlocks, and while in space for 10 seconds they become completely covered in ice and freeze to death.
Risk Aversion Kills Startups
How to Decentralize Twitter
Becareful with high nic. Dad started getting high blood pressure from vaping 24mg for 2-4 years. He's lowered it to 6-12mg solutions and have gotten better. His previous habit was about 2 packs a week, and in high stress situations a pack a day.
How would that work for people who do not have a FB account?
Background: Someone who has worked in the old Microsoft Analysis Services stack 8 years ago and has moved to more columnar data formats like parquet or row based MPP's.

Transition plan I would say is find the dataset that is exploding in size or complexity and start your POC there. I did customer service datasets on OLAP so it only grew at a pretty small scale and the data model didn't change that much. So OLAP was fine except for the fact that nobody else knew how to maintain it.

The main growing pain is find what your front end developer flow will be. It will be the same governance as the OLAP but more democratized so be ready to make your back end more front end. For MSAS it was excel but more modern systems are also more wide open. The article suggests just SQL but that can get out of control. How do you reduce reinventing the wheel etc? How do you prevent a lineage mess of derivative on top of derivative if you give users write access. Etc. IMO Tableau is a great product that allows the OLAP like exploration but can use SQL as an input. Just make sure people get the sql behind under some kind of source control and governance.

From the data model perspective it I think the main difference is make the tables wider and "pre join" in your immutable dimensions with higher carnality (ie customer). Just be careful of highly mutable data and keep those in separate tables because it is very painful to rewrite columnar data. Ie if you partition by date to update a single record you rewrite the entire date.

(About governance) I mean more passive governance not gatekeeping. Pretend each end user and dataset costs you money. How do you track them passively with some thin yet easily trackable logging? Business Unit and unique Job are bare minimums.
Does anyone know how tths story actually gained public recognition? I mean, its a dog from 1925, and back then, people weren't posting pics all day and the dog was likely also not featured in the daily TV news :-)
Maybe thats a stupid question, but I still wonder.
Great writing and clever hacking!
AWS Lambda Compared with Other Alternatives to Deploy Your Function
I’m reading Tig Notaro’s autobiographical book and at one point she’s demonstrating how well young her was doing out on her own by listing her budget.

Her cigarette budget was 80% of her pretty frugal food budget. If she hadn’t been smoking she wouldn’t have had to put so much time and effort into managing her food budget.

I wonder how much and how many ways our situation would have been better when I was a kid if my dad hadn’t smoked the entire time. Fucker used to hotbox us in the winter, too.
Bootstrapping a $30k/month Wordpress support service
For example, what Mercedes is missing for the EQC electric SUV production is, enough batteries for full production. I wonder how many other makers are looking at this particular bottle neck?
You dont have to miss those moments. Just join them, without the cigarette. In my experience noone cares if you dont smoke.
Btw it's going to be free to participate in group meditations till we are in Beta
You're right, I replied too quickly.

> We recently discussed new logging tools at work. It was either a redundant Amazon EC2 cluster with ElasticSearch for $50K monthly, or two large bare metal servers with rsyslog and grep for $400 monthly. The log ingestion and search performance was roughly the same...

If grep has the same search performance as elasticsearch, you should not be using elasticsearch and any comparison is bullshit.
In Russia, there are groups of swimmers who practice swimming in cold water. They are called "walruses" and they swim even at minus 10-20 centigrade. It's insane. I once watched a very old looking, skinny gentleman coming out of water. He still had his t-shirt on. He then took off his wet t-shirt, squeezed out the water couple of times, and then put (still wet t-shirt) back on, then grabbed his belongings and walked away. He wasn't even shaking. It was around late November. There was snow. I understand that the temperature of the river was maybe slightly even warmer than the air's, but damn, he put his cold, wet t-shirt on, and walked like it was July in Jamaica.
I was completely addicted to nicotine, and e-cigs couldn’t reproduce the hit from smoked ones.

After faffing two years with patches and liquids I took the Varenicline route... it was supposed to last 10 days and i stayed on it one full month but eventually I literally forgot to light up.

It works
Tesla made $105M profit in Q4 2019 after record deliveries
Heroku for personal projects
Two satellites just avoided a head-on smash. How close did they come to disaster
https://www.hetzner.com/dedicated-rootserver/matrix-sx

On their German website, you can bid for used-but-still-good servers and there you'll find great offers. There, you can also find hardware that they customized for others and then didn't need anymore. For example, I rented some GPU rendering servers for $110 monthly each from there.

https://www.hetzner.de/sb

Plus I can't praise their service and ops team enough. After we rented the new storage servers, I sent them an email to ask for it, and they then put the new storage servers on the same router inside the same datacenter as our other servers with them. Now we effectively have 2x redundant 1GBit LAN between our servers with them, plus an 10GBit internet uplink shared between our servers.

For that level of performance, they are ridiculously cheap.

BUT - and that is a big gotcha - you will be responsible for diagnosing hardware issues and asking for a replacement yourself. That's why we have RAID and two storage systems with them, because we tend to see one HDD fail every 3-6 months.
Hi!

1 - I am testing candidates. Giving them two paid tasks.

2 - I found time tracking tools to be inhumane, especially for creative work (like designers), but I do understand it can be useful for other job positions.

3 - We have 35+ staff, so while we don't have the most optimized productivity data, we have a good "benchmark" as we can compare employee performance.

4 - We give 2 warnings, with comments and opportunities to grow, then we terminate the employee. So far it hasn't happened yet.
I had never heard of that before. Thank you for pointing this out :)
India’s Most Abused Taxpayers
Caffeine works great on many mammals though, which is how you end up with your dog in the ER if you aren’t good at keeping things like chocolate or coffee beans out of reach.

Humans are just exceptionally good at metabolizing both.
Did Forbes.com Get Slammed by Google in Organic Search?
Cloud computing is kind of a joke. Yeah keep paying someone for shared "virtual computers", that sounds suspiciously similar to shared hosting from a decade or 2 ago... Oh but this is different, you get isolation from containers/VMs! Yeah ok, meanwhile new exploits emerge every couple weeks. It's like tech debt ideology on steroids... just keep pumping out instances until the company either goes hyperbolic, or goes bankrupt. Realistically, just buy a few physical servers and actually work to build efficiency into the system instead of just throwing compute at your public-facing web app.

I recently bought a DELL r710 just for fun and was pleasantly surprised how even days after spinning up a bunch of VMs, I don't have a 30gb logfile for all the failed attempts at getting into my instance (this was my experience recently with 2 cloud providers!)

It'll be interesting to see how the mkt reacts when you have a "first-of-its-kind" massive, massive security breach that affect popular "pure play" internet companies hosted on top of the mythical "cloud."

Seriously, $READER, look at your cloud computing-dependent startup, and calculate egress costs for your storage, as if you HAD to stop using cloud tomorrow. How much does it cost you? How could you adapt? It's designed to keep you dependent on 3rd parties... Idk, IMO it is really not great.
MongoDB vs. DocumentDB
We used Greylog in previous company and it worked perfectly.

Scaled to our needs but we might have used a cluster.
That's really cool! Added a reminder.
Or even quicker (no need to deal with Ansible) for IKEv2 IPSec only, my Bash script: https://github.com/jawj/IKEv2-setup
I used to admin OLAP infrastructure for a large Fortune 100. I think the article makes a lot of great points, but ultimately there are many paths to the same result. I'm not entirely sure what that group is up to these days but using column stores is a big part of it I'm sure, but I think ultimately deciding between precalculated vs. dynamically calculated pivots is the big choice.

Whatever system you have can do that, but the real work IMHO is understanding the org enough to cover the 80/20 of what people will want to see. Ideally you want to get to a higher level of abstraction such that you continuously codify your method of analysis or pivots to traditional tables if possible in order for maximum repeatability.

Sometimes I wonder if graphs or trees really make more sense though and OLAP being a tree of sorts is just a symptom of the RDBMS ubiquity, but this is just a meandering notion perhaps.
I'll add the same: idling does take a whole CPU in my situation too, and only on the mac, not on Linux.
A journalist originally noticed the dog and reported on him, thus capturing the imagination of the citizens of Tokyo.
https://www.hetzner.com/dedicated-rootserver/matrix-sx

They get slightly cheaper for large customers like us, plus you can get hardware upgrades like the 2x CPUs by paying for the difference upfront. So yes, it's $400 monthly + $2000 once, but those $2k don't really make much of a difference over the years that we've been running the system ^^
Why? Market forces dictate that they should charge _more_ (likely have less competition there; will also be able to provide better service than in densely-populated areas).
Sounds like they don't use file data checksums...

If they did, the dedup process for a multi tb drive would just be a few seconds, and the overhead would be so small it could be run on the whole drive every minute all day long.
There is no an easy answer.

The free market in case of todays "survaillance capitalism" doesnt exist and even worse, the price is very hard to find or define. With money it was simple, the product costs X, it offers me those features compared to other product that costs Y. That was it. You had a competition in term of money and features.

Today, google is free. How can you compete to that? With what? Will you pay your customers for using your software to be cheaper? Features that you need to develop without having money flow as you have to develop a whole advertising network to support yourself. You can have better software, but you will starve to death as you cant monetize it - as all ways for monetization come back to the company you are competing against. Also all distribution channels (android), all means to be actually found as competition (search). This is monopoly that has to be destroyed. It is bad for development of software industry, for freedom of information, for interney, for the human as species.

The future is not as bright as some people will like to belive, I think that at some point EU will detach from USA companies like China and Russia did, not for the censorship and control but rather to actually have any chance to compete on its own market. The USA companies are literally forcing it to by ignoring and workarounding EU regulations.
That would be something like:

* ToDo list with UI

* Stock Quote retrieval/analysis

* Toy VM/Interpreter
The multi screen sharing problem in Chromium is a known one. I've been following this patch for some time, and it seems to be close to release now: https://webrtc-review.googlesource.com/c/src/+/165724

As other commenters say, latest Fedora has Wayland and Pipewire properly configured and by enabling a flag in Chrome/Chromium (search by "pipewire") it will run smoothly and allow you to choose which screen to share.
What cloud advocates always say is that the $50k monthly will save you money from not needing to hire a team to manage it for you, and that over the course of 10+ years you will be ahead.

Is that true in anyone's experience? Every once in a while somebody posts about their competing bare-metal system and it looks like a lot of people have managed to cut their server costs by 99% (based on the numbers they post) by avoiding the cloud as a service

Honestly curious
A person who buys/sells the stock is responsible for their decision and it is no concern to anybody else if they are making or losing money. Particularly a flash crash. If they didn't want a stupid algorithm making their decisions for them they shouldn't have used a stupid algorithm.

I can understand the exchange rolling back half an hour of trading or whatever and calling it a wash. The idea that a trader is somehow liable for something seems absurd. Only thing he is guilty of is annoying powerful people.
That there is no point to open a bank account outside of China if he is trying to hide the money from the US.
If cross-platform tools are always behind because the native platforms change more quickly--and I think you're correct about that--then so are native apps that aren't constantly rewritten for the latest OS version. And then so are the native apps running on not-newly-upgraded client devices.

And since these quickly changing native OSes change in different ways, remaining "fully native" requires your app to have different UIs and feature sets, not just on different OSes but on different versions of those OSes.

If you have the resources to keep upgrading separate native apps for all the latest combinations of hardware and OS while also maintaining older versions, with different UIs and feature sets for each, you can have all the benefits of "native". Anything less, and you are deciding to live with less than "full native" and have to decide which compromises to make.

In that case, you might go for maximum speed with a consistent--therefore non-native--UI (PhotoShop), or good-enough speed with non-native UI that runs consistently and on even more platforms (a web app), or give up all but one OS but support all OS versions on all hardware (some dental office Windows app that hasn't changed for 15 years), or whatever. Or some cross-platform toolkit that will never completely keep up with "native" but might be okay, because you can't keep up with native either.
I don't love the look of the Cybertruck but what I do love is the value per dollar and the larger than expected cab space.
I just checked in Java, it is:

1. increment x, then take the value of x

2. take the value of x, then increment x

Both are expressions in Java returning a value. My C is very rusty but I remember it being the same in C.
I colored the prediction points in blue.
Some places still seem to go for large Kafka clusters just to calc some stats and forward some messages. I am sure some of their solutions are MapReduce below.
Fun fact: you can use Clojure with Jupyter: https://github.com/clojupyter/clojupyter

(Jupyter supports "kernels" and there are also more non-Python language kernels that you can use)
I'm confused again - wouldn't Elastic Cloud cost more than EC2? It makes no sense to be the other way around.

And secondly - why use logstash if you had filebeat - why not send data to ES directly? (I mean, specifically for your usecase, where you don't seem to need to do much processing prior to ingestion). Yeah, I saw that big parts of Logstash are in ruby so I expect underwhelming performance from it - but Filebeat should in theory be able to ingest large volumes of data into ES directly.
How did they connect at all with the wrong hostname?
I too had a longing and almost impossible to word admiration for girls beauty. Teenagehood only made it a sort of goal to chase and turn this into reality.. but the feelings weren't deeper. And tbh sex is another feeling on the side but it's not deeper than the previous sentiment.
You don't get to ask that question unless you've fixed a few of them yourself.
Most Effective Key Functions of Dynamics NAV
As a counter point, my current gas powered car only gets about 240mi/385km in range. And my car before that was 300mi/480km. So compared to that a 300mi range is perfectly adequate.
All that takes is you growing up or otherwise being acclimated to higher altitudes than her.
I want to say "it's complicated".

Probably any single protocol could be used to build a client that Slack or WhatsApp or [insert your target here] users would appreciate with good designers, (and/or with really little to no education.)

Multi-protocol clients are generally not optimal. The set of features that can be used will be the lowest common denominator, and if it's not the case there will be discrepancies in the design.

(Same story for bridges.)

Every protocol has their set of trade-offs, and every developer has their opinion on what's best (or the least worst). Also not every developer work with designers or have designing skills(!)

It's good for developers to be able to write what they want and how they want it. It's fine if their intended target is already with their circle of friends on the platform (if their is a target at all). It's less practical if the target is outside and their circle is not on the platform (network effect/peer pressure etc.).

That's a general "issue" in Free Software, (I'd say in software, maybe anywhere? it's just more visible here.)

Some might say waste of resources, but who gets to decide what to do with others' free time.. no easy answers.

(Sorry to spoil the fun by trying to rationalize :p)

I for one value freedom, through decentralisation (or federation as some like to insist on), and as technicalities I believe standard and extensibility of said standard are necessary. XMPP seems to fit this role ok enough to me.
Part of what makes it so galling is because Apple has those competencies in spades anyway (SREs, designers, datacenters, bizdev.)

Another aspect is that the App Store feels like a value-add for the actual marketed products — iPhones and iPads — and not something you are ever explicitly buying. It doesn’t show up on the receipt. People talk about buying a new iPhone, or getting then latest iPad. No one ever goes to the Apple store to buy the lates access to the App Store.

As such, Apple’s cut feels like it’s everything from cheeky to an abuse of their “monopoly” in the providers of iOS devices marketplace.
> I recently bought a DELL r710 just for fun and was pleasantly surprised how even days after spinning up a bunch of VMs, I don't have a 30gb logfile for all the failed attempts at getting into my instance (this was my experience recently with 2 cloud providers!)

That's weird. I run a couple of servers myself, recently installed Asterisk on one of them and in under a minute it was under a constant barrage of automated scanners.
Depends on how you want to use it.

If you want all your network traffic to go via your home network instead of normally over the internet, you will experience degraded network performance and it'll mostly depend on how fast your home network is & how far it is network-topologically from your phone.