Speaker A
Today, we're going to be testing out the top three harnesses to use with Quen 3.827B.
Testing top three coding harnesses with Qwen 3.8 27B on Minecraft and website generation tasks.
Key Takeaways
- Pi Harness at low reasoning level is the most effective for coding tasks with Qwen 3.8 27B.
- Hermes Agent is less efficient and requires more prompting to reach usable results.
- Minecraft clone generation is complex and requires iterative prompting to fix graphical and functional issues.
- Harness settings and reasoning levels significantly impact model output quality and efficiency.
- Visual and functional quality varies across harnesses, influencing their suitability for different coding tasks.
What the video covers
- The video tests three coding harnesses—Pi Harness, Hermes Agent, and Deep Seek Harness—using the Qwen 3.8 27B model.
- Two main tests are conducted: generating a playable Minecraft clone and creating a complex color palette generator website.
- Pi Harness is explored in detail, including setup, usage, and testing different reasoning levels (low, medium, X high).
- Low reasoning level with Pi Harness produced the best Minecraft generation, despite some graphical and functional issues.
- The Minecraft clone generated had some stuttering and incomplete crafting functionality but included features like block breaking and water jumping.
- Hermes Agent required extensive back-and-forth prompting and was considered the least efficient and placed third.
- The website generation test showed that while Pi Harness created a decent site, it was not the best visually compared to others.
- The video includes detailed terminal demonstrations and comparisons of harness performance and output quality.
- The creator emphasizes the importance of harness choice and settings manipulation to maximize Qwen 3.8 27B’s coding capabilities.
- Overall, the video provides a practical evaluation of harnesses for coding tasks with local large language models.
Chapters
- 00:00Introduction to Testing Harnesses with Qwen 3.8 27B
- 01:30Minecraft Clone Prompt Overview
- 03:18Pi Harness Setup and Initial Testing
- 05:01Testing Different Reasoning Levels with Pi Harness
- 06:30Results of Low Reasoning Level Minecraft Generation
- 08:08Gameplay and Functional Testing of Minecraft Clone
- 09:53Hermes Agent Testing and Efficiency Evaluation
- 13:38Website Generation Test and Visual Assessment
- 18:03Summary and Final Comparison of Harnesses
Full Transcript — Download SRT & Markdown
Speaker A
Now, I'm going to be using this on my 5090, and we're going to see which one does the very best at each coding task.
Speaker A
Now, for those of you that don't know what a harness is, a harness is essentially a program like Codeex or Claude Code that are used to manipulate the model. For most tasks like coding, the harness will manipulate the model in
Speaker A
a way where it'll use tool calling functions to try to get the most out of the model possible. So today, I'm going to be testing out Hermes agent. We're going to be testing out a very popular harness called high coding agent. And
Speaker A
we're also going to be testing out Deep Seek Harness, which just came out a couple weeks ago. So let's get into it.
Speaker A
Now, we're going to be doing two different tests today with these harnesses. Now, the first one is a Minecraft test. It is a massive prompt that I have come up with in order to see if it can actually produce a playable
Speaker A
version of Minecraft with all of the different functions that you would see in a normal actual standard Minecraft game. And the second test we're going to be doing is to see how well it can generate a specific pretty complicated
Speaker A
website. In this case, this is a color palette generator website. So, let's see what these harnesses can do with Quen 3.827B.
Speaker A
Now, for the first test, we're going to be using my classic Minecraft clone prompt. Now, this is a very extensive long prompt that I use with just about every single model to test it. And to put in perspective, the only model that
Speaker A
was ever able to actually one-shot this prompt was Fable 5 with Claude. So, this is, like I said, a very extensive prompt. I'm trying to essentially think of every possible thing that is in Minecraft and put it in a prompt that is
Speaker A
still like not too extensive, but still pretty long and has quite a bit of instructions.
Speaker A
Now, the first harness that I tried with Quen 3.827B was Pi Harness or Pi Coding Agent. Now, this is a pretty cool project. I know a lot of people in the comments were recommending this. I saw a
Speaker A
lot of recommendations as well, like on places like Reddit and whatnot. And you can install it on Windows and PowerShell. Looks like it has a Mac installation as well as some Linux options as well. So, before you do any
Speaker A
of that though, you will want to set up your settings. So, this one's pretty simple to get your settings set up. All you need to do is navigate to where it installed this coding agent and that's under this.py/agent/models.json.
Speaker A
So, if you just go into your PowerShell window and copy this command, it'll bring up a notepad and then these are all the different settings. So, you can copy my settings here. Essentially, what you'll need to do is import your API key
Speaker A
from Unsolo Studio. At least that's the engine that I'm using. I'm using Unsolo Studio essentially as the engine and then this is the coding harness that I'm using to test out some different harnesses to see what this model can
Speaker A
actually do. So Pi harness is very similar to something like Claude code in the terminal window. So as you can see here I have a folder that I made just for this Pi harness and I have some different projects in here. So what I
Speaker A
can do here I'm just going to do like a test folder to show you guys how this works. We'll just call it test and then go inside this folder here. And in Windows, if I hold shift and I
Speaker A
right-click and go ahead and open a PowerShell window in this folder. So you can see here it says Pi harness test and then it's very similar like I said to Claude code where you can just type in Pi in this case and it'll launch the Pi
Speaker A
coding agent harness. So, as you can see here, it is just like your actual terminal. Like I can actually interact with Quen right here. Just say hi and respond immediately. It said, "Hey, how are you doing today?" And then it also
Speaker A
is very similar in the fact you can do a forward slash and you've got all your different settings here. So, I've got different settings I can change. I can go ahead and look at the different models I have set up. In this case, I
Speaker A
only have Quen 3.827B set up. And then I can also change the thinking level. And what I noticed with this harness specifically is I think it is using its own thinking level with the harness itself. Because as you can see here, it has
Speaker A
minimal, low, medium, high, extra high. Whereas with Quen 3.827B, the only actual thinking levels that are baked into the model itself are low, medium, and X high. So, I do think that the harness is doing a little bit of a
Speaker A
manipulation here to change some of these different reasoning levels to make it a little more or less efficient.
Speaker A
Which is why with Pi specifically, I did this coding prompt three different times. I did it on low, I did it on medium, and then I also did it on X high just to see what kind of results we're
Speaker A
going to get from this Minecraft coding prompt test. So, in this case, I've got three different generations for the Pi model.
Speaker A
I have a low, medium, and X high because I was just curious to see how much different the generation would be. And to be honest, low is the way to go. I know I got a lot of people telling me
Speaker A
medium is the way to go. From everything that I've seen and all the testing that I've done, the low thinking level or low reasoning level is the best mode for Quen 3.827B.
Speaker A
And I'll show you what I mean here. So, this is the terminal window that I had it go back and forth with. Now, one thing with this specific harness, it did take a lot of back and forth to finally
Speaker A
get it into like a playable working state. It kept essentially like not showing certain textures like on the sides of the different blocks. And I finally prompted it the right way so it knew what it needed to fix, but it took
Speaker A
a couple times. That's why there's a couple screenshots in there that it could figure out what it needed to fix.
Speaker A
But after it was all said and done, it actually did end up fixing everything and giving me a fully playable Minecraft based on that 10-page prompt that I showed you guys earlier.
Speaker A
All right. And this is what the low generation produced. Now, you can see that it kind of has some weird stuttering issues. Like, I don't know what that is all about. It looks like the performance is jumping all over the
Speaker A
place. It's going from 240 frames per second, which was one of the qualifications in that full prompt, and it's also going down to like 30. So, but it does look like it produced, you know, like a full Minecraft looking
Speaker A
experience. Now, like I said, with this one, I had to go back and forth with it pretty often where the sides of these blocks were completely clear, like it was not rendering the sides of the blocks. But once it figured that out, it
Speaker A
actually is a pretty cool generation. And let's see if we can break the blocks here. Yeah, it looks like it has the breaking animations.
Speaker A
Let's break this wood here. Test out the crafting system real quick. Oops, didn't mean to pause it.
Speaker A
And okay, we got enough wood. Go ahead and see if this will work. So, see, it doesn't look like the crafting system works. The first step where we need actual wood is not even working. And I know I think it's just
Speaker A
actually just one. So if we just have one here. No, it doesn't look like it's working. Let's try to put it in all these slots. So yeah, the crafting system does not work. But I will say it does look pretty cool. Looks pretty
Speaker A
good. And it does look like it's like an infinite generation here. Uh, it's got nice water. Let's see if we can actually get out of the water. Oh wow, you can jump way out of the water. So it does
Speaker A
have a way that you can actually jump out of the water. I noticed that was an issue with one of my other generations where you have to like break a block before you can actually get out of the
Speaker A
water. So this one has like almost like a jumping diving out of the water, which is kind of cool. And yeah, like I said, it does look pretty good. Doesn't have the crafting system. And I
Speaker A
has zombies and everything built in. And there is, as you can see, some sort of weird performance issue. Like, wow, I just like jumped out of nowhere here.
Speaker A
Okay, so it's starting to get dark. Let's see what the zombies look like, and then we'll move on. I'll show you guys what the other generations did. And it was not very impressive on the medium or X high. I'll just uh preface with
Speaker A
that. But yeah, here we go. Looks like it has the creepers here. And oh, yep, they got the explosion animations.
Speaker A
Okay. And you can like hit them. Oh, I got them. Oh, there's a bunch of them around here. Oh, and it does look like they're damaged me. So, yeah, these are actually like real looking zombies, and they do hurt you if you get too close to
Speaker A
them. So, it has pretty much everything I had put in that prompt, minus the crafting system. And here it is on the medium generation. Like I said, it's pretty bad. It has all these like alien looking things. None of the textures
Speaker A
even generated. Like I don't even know what these things are. Like what? Like what is what is this? I feel like I'm in like the like an alien planet or something. Like what is that? It's like a downmation one. Like what what is
Speaker A
this? Anyway, whatever the medium thinking was, it completely failed. As you can see, like this is pretty freaky to be honest. And then I'll show you guys the X high. And then here's the X high. And X high actually might have
Speaker A
been worse than the medium. I in terms of like all the different creatures that were everywhere. I mean, it looks very similar. So I guess at least these creatures look like realistic. They're not alien looking. Oh, okay. Looks like
Speaker A
S goes forward, W goes backwards, and A goes the wrong way, and D also goes the wrong way. So, WSAD is completely backwards with every single key. So, not very impressed with X high either. In fact, X high might even be
Speaker A
worse if we're counting the WSAD controls for PI harness. So overall, it looks like the low generation is the winner. All right. So the next test I did was in Hermes agent. So I have Hermes hooked up to Discord here so I
Speaker A
can chat with it. And this is my head agent here, Hermes agent. And I made sure that every single profile and agent and model and also all the vision models were all set to Quinn 3.827B so it didn't like accidentally go to
Speaker A
like a fallback model like chat GPT or something like that. So, I put in this full prompt here in Discord, and it took quite a long time to come up with what I actually was trying to get it to
Speaker A
produce. Like, I actually had it with a ton of different revisions. Like, this was the very first one, and I think it was pretty bad to be honest. So, let's just take a quick look here. So, this was the first generation. I couldn't
Speaker A
click anywhere to start. Um, it looked like all that you could move around, but it looked like all the blocks were like kind of like dark and the animals were doing all these weird things with their heads. So, I went back and forth with
Speaker A
Hermes quite a bit to try to get it to like an actual playable state of Minecraft. So, in terms of efficiency, I think Hermes was the absolute worst. And in this case, I probably am going to put Hermes in third place. But let's go
Speaker A
ahead and look at the full generation after I went back and forth with it like a bunch of times. So, as you can see here, I chatted with it quite a bit and tried to get this whole generation fully
Speaker A
fixed and it was just didn't seem like it was getting it. And this one I also used like lowinking level cuz I was trying to keep them all on that same lowinking level because so far I found that lowinking is the best with this
Speaker A
model. So anyway, as you can see, quite a few different revisions, and this is the final product after I went back and forth with it, and I was like, "Okay, this is like essentially good enough." But Hermes overall was
Speaker A
honestly pretty bad when it came to like the first few generations. Like, it just could not get it done. Now, this generation is also kind of weird. Like, some of these animals are very interesting looking. It also has like
Speaker A
humans in this version. Like as you can see here, like I don't even think I asked for that in the prompt. So I don't know if it like searched the web and like found like humans. Then another thing I noticed is the breaking
Speaker A
animation. You can't even see it. Doesn't have any kind of block breaking animation at all as you can see here.
Speaker A
And then let's go ahead and see if the crafting works. See, now I can barely even tell if it's breaking the block because it has no animation. Okay, there we go. Now we've got five of them. Let's go into our menu here.
Speaker A
And it does look like it has a crafting system. Okay, so let's see if that'll work. But again, it doesn't have any really good graphics, so I can barely even tell if that is actually a table or not. Let's see what it'll do for us
Speaker A
here. I can scroll over to it and set it. It's also supposed to have a block in my hand, which so far most generations have not been able to figure that out. It does look like it's a crafting table here. And let's see. Oh,
Speaker A
that just brought up the other menu. So, as you can see, it's a crafting table, but it's not the right crafting table. So, it actually isn't a full crafting Minecraft, uh, per se.
Speaker A
It looks like it does, but it actually is only partially working. So, this one also is a failure when it came to the full actual like crafting system. And it does have a night cycle here. It looks like it is turning pretty quick. Let's
Speaker A
see if it has any kind of like zombies or anything. And then we'll move on to the deep sea harness generation. All right. All right, so I waited for it to turn into night and now it is officially
Speaker A
nighttime. So, let's go ahead and look around here. And you know what? I'm not even sure I'm seeing any zombies or anything. Like, I don't even think it got that there should be zombies at night. So, I think Hermes in terms of
Speaker A
this coding test, it's going to come in third place. Yeah. Let's look around here. Like, I you know, I guess there's a bird. Oh, there's bats. Oh, there there's a skeleton guy. That's kind of funny. I don't even think I asked for skeletons.
Speaker A
I actually just asked for the zombies and the creepers, but okay, they do hurt you. And can we attack them back? Well, doesn't look like it. And oh boy, there's a bunch of them. I can't tell if I can attack them or not because there's
Speaker A
no animation for like hitting anything, which is something that it missed obviously. Another thing that I noticed with this generation is it's not really that cool in terms of like different biomes. Like if we go through here, it
Speaker A
looks like it's just grass and trees and there's really no like mountains and the trees get like almost too thick.
Speaker A
If we look at this here, like look at this. Can't even walk through here at a certain point. Like you're just kind of come to almost a dead end. So the generation honestly is pretty bad. Uh, it does have zombies, but you can't
Speaker A
attack them. Look how dense this is. This is honestly crazy. Like, I I don't even understand what's going on here.
Speaker A
Like, this is actually crazy. And yeah. Oh, there we go. It did have some sort of hit animation.
Speaker A
Yep. Got him. But yeah, this is just not really a great generation overall in general. Looks like I finally did get out of the trees here. here. I don't know if I'm on the other side or where I
Speaker A
ended up, but anyway, the generation really isn't that great. So, now let's go ahead and check out Deep Seek harness generation.
Speaker A
And then finally, moving on to Deep Seek Harness. Now, so far, this is still my favorite harness to use with this model.
Speaker A
It is the best oneshot from a local model that I've ever seen from this Minecraft prompt. Now, this is something I did cover in my last video, but I didn't show the first generation. So, I gave it the full prompt here and it went
Speaker A
through and this is all on low again. By the way, I did do a test on medium and it completely failed. Again, I know a lot of you guys are saying to use medium. I'm just not seeing medium as
Speaker A
the best thinking model to use with this model. So, let's go ahead and check out the original generation. So, this was the first generation, which is actually pretty crazy that this is the original generation. Before I had it change and
Speaker A
fix a bunch of things, and it's really not bad at all. Like, it even has a block holding animation. You can jump around here. And it's pretty solid. Now, one thing that I had it fixed was at nighttime essentially, the zombies
Speaker A
didn't look very realistic. And I also had it change some of the different looks of the animals, but other than that, it did an excellent job. And this is the original oneshot generation, which this is, like I said,
Speaker A
the best oneshot I have seen from any model with any harness other than Fable 5. So, let's go ahead and look at the final generation. So, after I went back and forth with it a little bit, had it
Speaker A
kind of like I said, change a few different things here, like like let's look at one of these things here. Now, there are some features that still need to be implemented from the original prompt. So, I pretty much just told it
Speaker A
like, "Hey, can you go ahead and look at the original prompt again and just make sure you didn't miss anything?" And then I said, "The world is theoretically infinite. Is it not?" And it said, "Yes, it is." So, a bunch of different like
Speaker A
minor changes. make sure that it caught everything from that prompt. So, this is the final output after I had it change all those different things. And like I said, this is the best one I've ever seen from a local model with any
Speaker A
harness. And like I said, this is with Deep Seek harness. I think so far, Deep Seek is the best harness that you can use with any of these models. Like this is just one minor example of like a bug
Speaker A
that needs to be fixed. I have to put a block here. I have to break a block here in order to like actually get out of the water, but it has like as you can see like a block is in my hand of whichever
Speaker A
block is selected. I can, you know, take this block here, switch it over, and now it's like a dirt block. Another thing that is really awesome is you can see that these blocks are floating just like in the original Minecraft.
Speaker A
Like that's pretty tough to do. And even like models like Opus won't do that, which is pretty crazy. Now, one thing that I noticed that it does need to fix is the water does not fill in all the
Speaker A
way. It does have some problems with the water physics, but in terms of a generation and just like being also in a random biome. So, this one actually placed me in a random spot, whereas some of the other ones, they just put you in
Speaker A
one spot and that's where you always spawn. So, this one even has like seed generation as well. And let's see if I can get up to like show you guys like one of the mountains here. and then I'll
Speaker A
show you guys the fact that this has a full crafting system that actually works and this is almost like a playable Minecraft. Now, one of the bigger problems that I noticed here is takes a really long time to break the wood
Speaker A
blocks. So, I'm going to speed it up and just get some of these wood blocks here and then we'll come back and test out the crafting system. All right, so I finally got the wood blocks to break here and
Speaker A
let's just do this. And you can even see that it has like the actual like wood like different uh pallets or different like tiles I should say or the different wood like you saw that in the Hermes generation where it was just a generic
Speaker A
like blob and you couldn't even tell what it was. So let's get our crafting table here and same thing. You can tell this is a crafting table. Put it in our inventory and then we can scroll over to
Speaker A
it. There we go. Set the crafting table down and then test out this. So, this is the only one that I noticed, too, that actually worked with full crafting system. So, actually, real quick, I need to make some wood blocks. Then go back
Speaker A
in here. Let's go ahead and just make a pickaxe. And I actually know this already worked.
Speaker A
So, actually, hold on. Rookie here. Got to make the sticks first, right? Okay. Grab our sticks.
Speaker A
Grab these. Three here. Two here. And there you go. Got ourselves a pickaxe now. And then we can scroll over to it. And you can even see it's like technically in my hand. Like it doesn't look as good obviously as
Speaker A
like normal Minecraft. But in terms of like something that is functional, you can see that it is breaking the blocks way way faster. Guess the wood blocks are still kind of glitched out where they need to be maybe a little faster to
Speaker A
break, but and okay, you can see it's turning to night here as well. And there is a bunch of zombies after me. We're in a actual pretty hostile territory. And there's even creepers. And they have like the full explosion thing going on.
Speaker A
Let's get one to explode here. Oh. Oh, maybe this is a this is a dangerous situation here. Trying to get one zombie to load.
Speaker A
Come on. There we go. So, that might need a little work, too. But in terms of like an actual like generation, this is honestly blowing my mind how good this is. And the fact that it almost nearly oneshotted that crazy
Speaker A
11page prompt is actually insane. So pretty much I have a full playable Minecraft with a few different bugs that I need to iron out like the water not filling in. But in terms of like the look, the biomes, the water, the
Speaker A
crafting system, the zombies, like the functionality of it, this is a crazy good generation. And again, this was done on low. So for the gaming test right now, we are giving Deepseek the win. So now, let's go ahead and move on
Speaker A
to our website generation test. All right. And this is the color palette website prompt. Now I generated this prompt using actually chat dpt and it was for codecs to make a similar website. And I actually have a video
Speaker A
about that if you guys want to check that out. I'll link that in the description below. But this is a 17page prompt essentially telling it exactly what I want in a color palette generator as a website. And I'll also make sure to
Speaker A
host all these prompts. I like to host all my prompts for you guys so you guys have access to everything that I'm showing you guys on screen. So, starting out with Pi Harness for this color palette website that I'm trying to have
Speaker A
it create. This is entire process from the Pi Harness and it didn't actually take too long to make and it made a pretty decent looking website. I wouldn't say it was the best out of all the different harnesses that
Speaker A
we're testing today, but it is a functional site. And it went through and essentially what I did for all three harnesses is I gave it the same prompt that we just looked at earlier. And then it gave me some recommended
Speaker A
improvements. And for each one, I said, "Please implement all suggested improvements." Tried to keep this like an even playing field. Whereas the Minecraft was a little different because I kind of had to go back a few different times. Kind
Speaker A
of gave it the benefit of the doubt with each harness and tried to fix a few things before I finally called it quits to do the full comparison. And this is the website that Pi Harness actually ended up creating here. So, it is a
Speaker A
functional site like I said and it has a bunch of different options. It has a random mode, generate different pallet options. You could do vibrant and they all seem to work exactly as intended.
Speaker A
Like if I go to pastel here, it also seems to be showing me pastels. And then you can change how many you want. So that works as well. It can go up to eight. And let's see, let's try to do
Speaker A
like a dark. So yeah, dark is very similar. So everything is working as intended here. And you can even drop an image in here. And the website overall does look pretty nice. So, it has a dark mode and a light mode. However, I don't
Speaker A
think this is the best looking website out of all the harnesses. Like I said, it is very functional. It gives you all the different CSS variable, Tailwind.
Speaker A
So, these are all part of that prompt where I told it, I want all of this on this website. So, it did pretty much nail everything. However, in terms of visuals, I don't think personally this is the best looking one. Now, moving on
Speaker A
to Hermes. Hermes took the longest once again out of all of the coding harnesses. And I'm not really sure why that is, but it seems to take much longer than the other two harnesses. And it produced a pretty decent looking
Speaker A
website overall. So, it came back and I did the exact same thing. I told it like, "Hey, please implement all suggested changes cuz I want to keep everything the same for this coding test." and it came back and it actually
Speaker A
produced something that was pretty crazy looking. All right, so here's the website that Hermes generated and this one actually looks pretty good. Let's do a quick generate pallet. It looks like the pallet generation is working. Let's do random. Yeah, random is working.
Speaker A
Let's do pastel. Let's see. Yep, those look like pastel colors. And then vibrant. Yep, definitely vibrant colors there.
Speaker A
And then dark. So, yeah, this does seem to be working. And it has like a save function. I don't know how well that works. Save pallet. It uh says it's saved on device. Okay. And then it has some export features here. So, same as I
Speaker A
pulled it in that prompt to add. And honestly, the style actually looks pretty good. I really do actually kind of like the style with the dark theme.
Speaker A
And oh, it looks like it has a light theme toggle as well. and pretty cool logo up here. So, yeah, this looks pretty solid and it has all the information that I told it like I wanted the frequently asked questions and the
Speaker A
about and practical tool color tool. Okay, looks it has some instructions down here. Go back to dark mode cuz that's a little blinding. So, yeah, right now I think I'm giving Hermes a one up on pie harness on low what we
Speaker A
just saw here. So, this looks pretty solid. And finally, we have Deep Seek Harness.
Speaker A
Now, let's go into our project folder here. I really do love Deep Seek Harness. It looks just like Codeex, and it's in the web browser. I think it looks honestly awesome. So, it's telling me that it's being hosted on localhost
Speaker A
3001. It probably So, it looks like I need to start it here. All right. So, I just had to have DeepSeek start the web server. I had to restart my computer. So, I had to start it real quick. And this one looks
Speaker A
amazing. I did a really quick preview on this, and I was honestly blown away by how good this looked and also how close it looked to something that I generated with chat GPT 5.5 a couple months ago.
Speaker A
So, let's see how well this works. Generate pallets. Yeah, it looks really good. Uh, it's got a good logo right here. Let's change it to pastel. Yep.
Speaker A
Pastel is correct. Change it to vibrant. Vibrant looks good. Let's just try another one here. Let's try uh complimentary.
Speaker A
See what that is. Oh, I see. Okay. They're just essentially colors that are complement each other. So, that looks pretty solid. And then, yeah, if we scroll down here, it's got everything that I asked for. The export your
Speaker A
palette in CSS and all the different formats there. And then it has a save pallet function.
Speaker A
Download SVG. Now, one thing that was a little different from that first generation, it had like a way to like put a photo in here. I don't see anything like that.
Speaker A
So, that one actually took that on its own. But, I think in terms of like just style and how this looks, I think this one honestly looks the best to me overall, like in terms of just professional looking website. And just
Speaker A
to put it in perspective, this is a website that I actually created and I showed everyone how to actually host their own website and everything. That was a past video I did on codec. So if you're interested, go ahead and check
Speaker A
that out. But this is just a comparison to show you guys how close DeepSeek actually got in terms of like style.
Speaker A
This is my own custom website that I actually came up with and I bought the domain and everything. If you brew.app app and it looks pretty similar and it almost looks like it acts pretty similar as well. Though this one is a little
Speaker A
different. Has like different buttons for mood. So obviously this one is a lot more advanced. It has different like seeds. You can change it to like earthy futuristic and it does pretty much the same thing with like exporting the pallets but it
Speaker A
has like a contrast checker and everything else. But in terms of style, I think Deep Seek honestly got the absolute closest when it came to actual style. Here it is right here. So yeah, this looks pretty similar overall. So as
Speaker A
for the final verdict, I would say in this test that Deep Seek harness scores the number one spot in terms of the best harness so far that I have tested. I would say that pie coating agent harness comes in at number two and surprisingly
Speaker A
Hermes agent coming in at number three. So anyway, that'll do it for this video.
Speaker A
If you guys have any questions, let me know down below in the comments. Let me know if there's any harnesses that you would like me to test out. And stay tuned for my next video. I plan on trying to get Quen 3.8 Flash running on
Speaker A
my Mac Studio. So, if that's something that interests you, consider subscribing to the channel.
Topics:Qwen 3.8 27Bcoding harnessPi HarnessHermes AgentDeep Seek HarnessMinecraft clonecode generationlocal large language modelAI coding toolsmodel evaluation
