>This repository provides a patch for SGLang and vLLM that enables IndexCache inference acceleration for models using DeepSeek Sparse Attention (DSA), including DeepSeek-V3.2 and GLM-5.
Paper here [1].
[1] IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse:
> Call it AI-first, AI-proficient, whatever you like
Can we just call it AI assistant and since it is really what it is. Just call a spade a spade, call it a day.
Nvidia boss Jensen Huang refer to AI as teammate in his recent COMPUTEX presentation, but it's disingenuous to call that since it's a just tool, but a very potent tool nonetheless. He's obviously biased to a fault but he's literally banking his company on AI now, but for the rest of us AI assistant should do more than fine.
Calling it teammate, workmate or friend is also rather childish. It's like having an imaginary friend that can lead young people to do silly things and this risk probably can be extended to junior developers [1],[2].
I think the replies were pre-mature since when I commented on HN the comments total still has not reached 1000, but he already linked the replies already in the blog. Perhaps should have waited the comments to settle down in the original HN post, so that he can chose the most relevant and the interesting comments before posting the replies.
Personally, I'd really appreciate it if the original OP article author can respond to my comment in the previous post [1].
Last year I was in a Samsung shop when one couple remarked to me that it was the second time they came to buy the same phone for the wife in a month. Then naturally I asked for the reason why, I thought they like it so much to buy a second one.
Apparently the couple just recently come back from a trip in Ireland and lost the new Samsung phone there. Someone has stolen the wife's baggage from the bus when it's doing the routine transit stop by the bus stop while opening the bus baggage conpartment. By the time they realised the thief already going away from the bus with the baggage with the new Samsung phone inside it. They reported to the police but nothing happened. In UAE, Singapore or Japan this type of crime is just not worth it since the petty thief will be punished severely. A lady can incidently left her Louis Vuitton bag inside a restaurant in Dubai, left it at her seat, then after a few hours come back to fetch the bag without losing anything inside.
there was a recent case of a kid who was literally stabbed by a sihk guy and got arrested because the sihk guy said the guy said something racist.
Now before you say that I need to check my white privilege, I am brown. everytime one of these people commit these crimes and the police look the other way in the name of political correctness, it gives legitimacy to the racists who want to cast all of us in a bad light. Law and order needs to be a applied equally and its very strange to me how people are getting arrested for speech when they are a direct consequence of government policies. don't make teh speech illegal, correct the issues the=is speech is surfacing.
> As of March 2023, Emirati authorities continued to incarcerate with no legal basis at least 51 Emirati prisoners who completed their sentences between 1 month and nearly 4 years ago. The prisoners are all part of the grossly unfair “UAE94” mass trial of 69 government critics, whose convictions violated their rights to free expression, assembly, and association. UAE authorities used baseless counterterrorism justifications to continue holding them past their completed sentences. Some prisoners completed their sentences as early as July 2019.
I sense FUD in the OP article towards AI, and we have similar article every week on HN now it's starting to become repetitive and tiresome. As of now this OP article is close to 1000 points and 1000 replies. Apparently this FUD seems to resonate with most people at HN, naturally so.
Ironically the entire blog title is the "human in the loop", is probably the biggest counter argument for this FUD. The AI will never ever be concious and responsible, and to function and govern properly in the universe you need to be concious. AI I repeat will never ever becomes one. Not even in the popular fictional Star Wars movie franchises where you can have cute robots but they all devoid of the conciousness for the ever powerful force. Heck even the clones cannot control and balance the force, the Star Wars ultimate conscience.
>Of course, this is good for brilliant engineers that never had the chance to get deep into the domain and now have better chances at getting a job, but it's also sad to think that other brilliant engineers that spent their lives collecting domain knowledge are now competing on the same lane.
Actually overall it's definitely a very good thing for humanities. For example, currently it's very difficult to become a medical specialist and most medical students just stop at GP. But globally there are severe shortages of medical specialists for example typical cardiologists to patients ratio in developing countries is about 100,000:1, and for neurologists it's even worst.
Let's say with AI enabled tools and LLM now these GP can upgrade themselves to become cardiologists easier than before. Let's say due to AI/LLM suddenly there's a big jump of the ratio to 10,000:1 or 10x incraese and improvement in the number of cardiologists without degrading much of the quality of services. Imagine if the typical waiting time for important and necessary procedures like angiography now is reduced to merely days or weeks rather than several months or up to a year. Thus naturally the salary of cardiologists will be not be as high as now, but they still will be compensated handsomely. But as humanity do we really care the cardiologists family just live in semi-D landed houses instead of bungalows, not much me think.
While these 3 companies namely Micron, SK Hynix, and Samsung produce RAM modules, TSMC does not.
TSMC from day 1, is mainly focusing on outsourced fabrication for computing system where RAM memory is fabricated just as embedded component or sub-system of a complete system.
While increasing the price of thus RAM sub-component seems very attractive for short term gain but I think TSMC is focusing on long term business srategy where sudden RAM components price increased does not effect much of their overall profits.
I think D got it right by not supporting any macro, and become very fast in compilation while being consistent in the syntax, easier to maintain and debug. This remind me of a famous quote, "Debugging is twice as hard as writing the code in the first place. Therefore, if you write the code as cleverly as possible, you are, by definition, not smart enough to debug it."
D also show the programming world that you don't need to go macro, or Ruby styled 'macro' that can create complicated franskeintein codes in order to achieve good metaprogramming capability [1].
[1] Metaprogramming is less fun in D (88 comments):
IMHO, for effective computing in the Internet era, we should not be depending on classical OS or application centric but data-centric. Otherwise it will be always a mismatched of abstraction between OS and application. In this case a web OS inside a classical OS, remember webOS anyone [1]?
This should a new data-centric OS similar to TabulaROSA in concept where data is managed and governed by mathematical relationship in this case associative array based D4M [2],[3].
This concept can be implemented initially on Linux, since now Linux support generic non-conventional kernel bypass for memory, storage and compute with io_uring and eBPF, for examples [4].
> I wonder what's the responsibility of various factors behind their success. Is it mainly the people? Strategic location? Great governance and policies?
It's mainly its strategic location and it's always been the the busiest maritime route chokepoint since recorded history between east and west, specifically between India and China two of the most populous nations in the world.
It sit right at the tip of the Strait of Malacca, the busiest and the longest strait in the world. This one famous quote by a 16th CE Portuguese explorer Tomé Pires, who declared: "Whoever is lord of Malacca has his hand on the throat of Venice".
Secondly is the people, and the third is the governance policy. Essentially, you must have be a bone-headed to screw up Singapore, like the one who can bankrupt a central bank.
My original top most comment on the great lie of Singapore was just an obscure fishing village during the early colonial time but it's has already downvoted to oblivion, you can check them out if you want.
The reason for your last point is that Singaporeans are taught in school that we were nothing but a fishing village until first colonialism (and Chinese immigrants) arrived and turned us into a major port, then the PAP (Lee Kuan Yew's party) turned us into a first world nation. It's really propaganda, and of course you wouldn't bother looking up information that you were taught to see as truth when you were a young child
Many post-colonial societies (Arabs, Indians, etc.) puff up their supposed past wealth and success, but that’s the real propaganda. Even when these countries were on important trade routes or whatever, the per-capita GDP of these places never went much above the subsistence level. High estimates of the per-capita GDP of the Roman Empire have it at around half of modern India. These societies were very poor in pre-colonial times.
> Essentially, you must have be a bone-headed to screw up Singapore
The place that is now Singapore had less than 1,000 people when Raffles got there. So what happened?
There’s lots of places with strategic locations or natural resources or such advantages. The U.S. has the largest contiguous stretch of fertile land connected to one of the largest navigable river systems in the world. But the north american indians did essentially nothing with it. It’s not easy to make a modern civilization out of even a favorable geographical situation.
Need to check the veracity of this 1000 population claim by the master colonial no less.
The British took over Malaya from Dutch with minimum effort, by exchanging some of their Indonesia colonies after an agreement with another colonial power. Fun facts, that's how Batam Islands got under Indonesia.
The first thing they did was to create Strait Settlements with strategic and rich Malayan States including Penang, Malacca and Singapore, definitely any of these was not an obscure fishing village [1]. These are the major trading ports for Asian major empires including Langkasuka, Srivijaya, Majapahit, Chola, Malaccan Sultanate, etc.
[1] Fungi and humans: closer than you think:
https://www.cell.com/trends/genetics/abstract/S0168-9525(01)...
[2] Three reasons fungi are not plants:
https://asm.org/articles/2021/january/three-reasons-fungi-ar...
reply