

Thanks! now I feel a bit lazy since there was a whole wiki article on their relations that I could have just looked up. Sorry it’s early in the morning here… appreciate it
Thanks! now I feel a bit lazy since there was a whole wiki article on their relations that I could have just looked up. Sorry it’s early in the morning here… appreciate it
Upvoted for the info about Greek support for Israel. I didn’t know that was a thing. Any other context for why that could be?
Looks like it now has Docling Content Extraction Support for RAG. Has anyone used Docling much?
Oh and I typically get 16-20 tok/s running a 32b model on Ollama using Open WebUI. Also I have experienced issues with 4-bit quantization for the K/V cache on some models myself so just FYI
It really depends on how you quantize the model and the K/V cache as well. This is a useful calculator. https://smcleod.net/vram-estimator/ I can comfortably fit most 32b models quantized to 4-bit (usually KVM or IQ4XS) on my 3090’s 24 GB of VRAM with a reasonable context size. If you’re going to be needing a much larger context window to input large documents etc then you’d need to go smaller with the model size (14b, 27b etc) or get a multi GPU set up or something with unified memory and a lot of ram (like the Mac Minis others are mentioning).
Hopefully these improvements will become available to other Nvidia GPU architectures like Ada and Ampere in the future as well.
I think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.
The US government’s position on this can be summed up as “massive unaccountable US tech firms having all of your data and manipulating public opinion via their black box algorithms is okay, but Chinese companies doing that is a national security concern”. I call BS. The degree to which China is actually a US adversary is being massively overstated by the US government as they see this as a threat to US geopolitical hegemony and America’s ability to propagandize its own citizens. I have spent some time on RedNote (Xiaohongshu) and all I have seen is friendly cross-cultural exchange and discussion between these supposed ‘adversaries’.
I believe alternative methods of validating blocks (series of transactions) such as Proof-of-stake, instead of the vastly more computation and energy-intensive proof-of-work that Bitcoin uses would largely address the issue of computational expense. There are other methods of increasing efficiency and speed of processing as well such as the use of more efficient ‘layer 2’ mechanisms for processing blocks. I remember reading about these and their implementation when I was researching cryptocurrencies out of curiosity. I believe Ethereum and some others have largely implemented these. The decentralized applications aspect of Eth was super interesting to me as well. Basically, you can program software to run on the blockchain which can make it nearly impossible to shut down by a centralized authority so long as the network is sufficiently decentralized. Some of the programmable money (so-called decentralized finance or ‘DeFi’) apps are pretty interesting as well in terms of enabling more people to utilize the more complex financial instruments that Wall Street firms have been using for years. Of course, a lot of that has turned into a Wild West of scams and ‘rug pulls’, not to mention massive targets for hackers who try to exploit vulnerabilities to steal millions so buyer beware for sure.
Tend to start with top (day) for my subs and then switch to scaled once I get down to posts that are below 100 upvotes or so to see more posts from smaller communities that can’t make that ‘top’ cut.
The guardian article only summarizes a limited amount of the product test information. See here for more products that were tested: https://www.mamavation.com/health/condoms-lubricants-pfas-forever-chemicals.html#Not_Our_Favorite_Condoms
Furiously hammers X to doubt
This kind of technocratic approach can sound great and it’s always good to have policy and positions formed by those most knowledgeable in the relevant field. The problem is that the “experts” that will likely have her ear will be the ones that are vetted and approved by the power elite, the wealthiest in this country who will largely recommend what is best to protect their privilege, wealth and position.
Agreed, but it’s not gonna happen. Too far left, two demonized by the right and I don’t think they want two women on the ticket. It’s 2024 and sad to say it will still be hard enough to overcome sexism for many voters just for Harris.
Interesting project. Is it actually possible to track workouts using your phone or smartwatch without needing proprietary third-party apps like Strava or Garmin Connect though?