(eng) Valentin is back again

Valentin came to visit us again, and this time we spoke about the issues with open source software.

joinit
joinit
(eng) Valentin is back again
Loading
/
Zobraziť prepis

drunkez

JoinIT.online.

Stop, stop, stop swearing on him. He's, he's- ... already recording, right? I mean

join3r

Yeah, sorry guys for being, uh, very, very late, but, uh-

drunkez

Like always.

join3r

Work never sleeps.

drunkez

Yeah, work never sleeps.

Valentin

Depends. Sometimes-

drunkez

When you turn off-

Valentin

Yes

drunkez

... when you turn off your phone and close your laptop, I mean the work sleep well.

join3r

No, no, no. No, no, no. Uh, everything catches up once you wake up and-

drunkez

Yeah, and go to work

join3r

... and inevitably go back to work. Yeah, everything catches up.

Valentin

Yes, yes, yes.

So it's nice to see you guys again. I haven't seen you in, I don't know, one week or so.

Uh, and, uh, yeah, thanks for the invite.

Um, I, I don't know if you-

join3r

What invite? We just wanted to record, and you were suddenly here, right?

Valentin

Yeah, yeah.

join3r

I don't know how you got here. I didn't send you a link.

Valentin

Suddenly planned.

drunkez

It's so annoying. You're always trying to get in, and you-

join3r

To join into the podcast

drunkez

... just made it today.

join3r

Yeah.

Valentin

The, the problem is that you, you have to change now the link because I have it, so I can join each time and then, like, uh- Yeah. Yeah.

join3r

We changed it twice already, and you are-

Valentin

Oh

join3r

... still here, right?

Valentin

Still here.

drunkez

Yeah, I mean, you know, this is the power, this is po- this is the power of, uh, dark, uh, darknet or dark web, you know, where you can find these links.

Valentin

Yes. Yes, yes, yes, yes, yes.

drunkez

Okay. Speaking about the dark web, uh,

I mean, I got a question for you guys. I mean, you're working for the huge companies. Sorry, join3r.

But anyway, still, still there is IT, and there's, uh, a lot of packets going through the networks and a lot of customers being served by the infrastructure you got.

Uh, what are you doing against the ransomware? Because I thought that the ransomware is gone. I mean, it was the wave four or five years ago, like everyo- and every- everybody was like somehow hit by that, and I thought, "Yeah, it's gone." It's, it's IT companies got solution for it. There is the decryptors, and you have the snap shots, and blah, blah, blah, you have plenty. No, it's not. I mean, it's, it's, it's just, you know, it's so going on. I mean, I just heard, uh, last week about two major companies, one of it, mm, military, which is very sensitive of course, w- were hacked, and they're, they're trying to be, uh, uh, blackmailed and blah, blah, blah because of the ransomware. And I was like, "Yeah, I mean, not, it's not gone." It's probably just, um, probably better and more, more high use or whatever. Nobody's again- uh, nobody's, uh, like, uh, spreading this information. "Yeah, we've been hacked," but it's still there. Have you hear- have you heard about anything like that in last weeks or months or whatever?

join3r

Yeah.

drunkez

All of you?

join3r

When, when-

Valentin

Yeah

join3r

... you check BleepingComputer, for example-

Valentin

Yeah

join3r

... which is a pretty good website-

Valentin

Yeah

join3r

... that there is a lot of ransomware still ongoing. It just not getting, uh, the, the traction, right? Because it's, uh-

Valentin

Yeah

join3r

... it's old news, right? Every what- all- there is always someone, some big company, someone that, that, uh, that gets it. And of course, I can say that we are completely protected against ransomware, and, uh, we are not afraid, uh, uh, about anything.

drunkez

Yeah, yeah.

join3r

That's the PR answer, right?

Valentin

Yes. The, the, the official answer, yeah. Uh, so, okay. Uh, I always hear constantly about it because I, I listen to some podcasts, and yeah, they give like the, let's say, always the updates, like regarding some, some of these attacks or data leaks or hacks or whatever.

drunkez

Yeah.

Valentin

And yeah, I hear it constantly, yeah. Uh, I think it never goes away. Maybe, let's say, it's not such a high number anymore, but it-

join3r

Yeah

Valentin

... still happens, and most of the companies hid it, so try to hide it at least. And then if someone, some, uh, regulation body catches up with them, then of course they have to disclose it and pay some fine and la, la, la. But most of the-

drunkez

Yeah

Valentin

... time they try to hide it-

drunkez

Yeah

Valentin

... because it's actually cheaper to hide it on the, let's say, uh, image, uh, side and also on the

security side.

drunkez

Yeah, there is-

Valentin

Yeah.

drunkez

Yeah, yeah, there is a reputat- reput- re- um-

Valentin

Yes

drunkez

... reputation issue of course

Valentin

... branding and everything, yeah.

drunkez

But I think, I think the company pays. We- you know, the five, four, from whatever years ago, they was like, "No, we are not dealing with terrorists, whatever, hackers. We are not paying you."

Valentin

Yeah.

drunkez

"Whatever. We will rather, we would rather, uh, burn this company, but we are not spending a, a penny." Yeah.

Valentin

I also believe-

join3r

No, but the problem is when it-

drunkez

A lot of them pay, yeah. Sorry.

join3r

Uh, once you pay, right, they, they send you a tool which will decrypt the, the stuff that you have encrypted, right?

drunkez

Yeah.

join3r

Do you really trust them to, to run a, to, to, to run a, their tool, right? That, that's the first part, but there is also, there are also, mm, I think one major, uh, antivirus company was creating a tool which could de- decrypt. That, that means that, uh, the, the, the hackers, the, the ransomware criminals could send you just the key. You would essentially have a good tool that could decrypt the data from that antivirus company, and you would just insert the key, and it would go over and be decrypted. Yeah.

Valentin

Yeah. The, the problem with that is like, like you said, do you trust them to really not give you with the tool any some, like any other kind of- Let's say Trojan, uh, or virus or whatever. And then the second option is once you got hacked, there is a huge, uh, chance or high chance to get hacked again.

drunkez

Yeah, yeah.

Valentin

And usually-

drunkez

Yeah

Valentin

... yeah, the paying, the paying of the m- ransom is, of course, just a fast and easy way to get your data back, but that's not-

drunkez

Yeah

Valentin

... going to solve your issue, right? So this is one of the big problems, right? So we also have... So in my case, right, for the place I work, uh, we have dedicated security, uh, teams and everything, and, uh, yeah, they try to enforce, uh, yeah, uh, requirements and regulations, and each, uh, let's say, project needs to be approved and has to be, uh, has to meet some sort of, uh, requirements in order to-

drunkez

Yeah

Valentin

... go in production and the whole shebang, right? But, of course, um, it's not always so easy, and because you have such a huge infrastructure and with so many components, um, sometimes, of course, you're going to get affected, yeah.

drunkez

Yeah, sure.

Valentin

Yeah.

drunkez

I mean, this, this, uh, this, uh, attack vec- vector is actually probably the most, uh, burning place or most, uh, concern-

Valentin

Yeah

drunkez

... biggest concern, right, what's the source.

join3r

That, that there is money behi- behind it, right? Because those criminals can get the money, and money is a powerful motivator. And so-

drunkez

Yeah, it is

join3r

... uh, but, but I want- wanted to say I worked in one of, uh, one company that, uh, got ransomware and, um,

they, they didn't pay, right? Because the, the data that was, uh, that was encrypted, uh, was not, uh, yeah, it wa- it wasn't, uh, important or anything. Uh, the backups didn't go f- for far enough that, uh, they could restore the data, but it was not important. But the major problem was, right, because I was then asked, "Okay, is there some, uh... How do we, how do we prevent, how do we figure out if there is some, uh, ATP, the, the, mm, advanced, uh, how is it called, threat?" Uh, if, if, if, if-

Valentin

Advanced persistent

join3r

... if there is some, some resident i- issue there, right, that they put some- something inside the network that you don't know about, right, that they have-

Valentin

Some backdoor somewhere

join3r

... still control over, yeah.

Valentin

Yeah.

join3r

And, and, and how do you figure that out, right? And, and I was like, yeah, at, at that point it's, it's easier than, easier than going through all the servers, right, on that network and looking for it, right? And, and never be actually 100% sure that, that you got everything, right? Just reinstall it, right?

Valentin

Yes.

drunkez

Yeah, yeah.

join3r

Just, just start from scratch to scratch, right? And, and that's, that's also where... Because the, uh, the, the task itself of reinstalling that, the, the part of the environment, right, it wa- it was, it was kinda, uh, isolated, so, so it was p- pretty fine. But the, the task of, uh, reinstalling it, that, that actually cost more than, than if you would actually pay, pay, right, the, the, the ransomware. Because the ransomware was, I don't know how much money. I, I, I don't know exactly, right? And, but, but I know how much m- money it costs to reinstall those servers, right?

drunkez

Yeah.

join3r

How much manpower was, was spent and stuff like that. I, I've, I've seen the, seen the numbers, right? And, and it's a huge number, right? Yeah.

drunkez

Yeah, that was for me, man.

join3r

But it's, it's difficult.

drunkez

I, my ransom was, uh, one Bitcoin,

and it was, uh, when the Bitcoin was

3,000 euros or so.

join3r

Okay.

drunkez

Super cheap.

join3r

Yeah. Yeah. You, you, you got away ch- cheap, right?

drunkez

Yeah.

join3r

But, but you didn't pay.

drunkez

I didn't.

join3r

Yeah, yeah.

drunkez

No.

Valentin

So I-

drunkez

It was too much.

Valentin

So I didn't had this, this issue, but yeah, I also heard from other places, from other guys saying like, "Yeah, the only way to be sure that it's clean, you have to reinstall from scratch, and that's it." So, and this hurts so bad, right, when you have some sort of environment which is built, configured. You don't have any automation in place, right? You did it by h- by hand or whatever, and then you configured all these tools and s- and software and shit. And at the end of the day, like, after you have it in place and running everything, you have some guy telling you, you, you have to reinstall everything from scratch. I'm sure some-

drunkez

Yeah, but they, they have two options

Valentin

... I'm sure, I'm sure a lot of guys wept.

drunkez

Either it will stay crypt.

Valentin

So yeah. Sorry. Yeah, please go.

drunkez

Yeah, I mean, yeah, it will just stay crypted, or you have to reinstall it, so pretty much.

Valentin

Yeah.

drunkez

It happens, yeah.

Valentin

I would-

drunkez

Uh-

Valentin

... I would re- reinstall it, for sure.

drunkez

Yeah, sure. Yeah.

Valentin

But I'm sure it would be a pain, a pain experience, right? Even if you have automation in place, after changes and everything, nobody... So it's not going to work. For sure it's not going to work anymore. You have to then update your automation in order to make it work. You invest much more time than just installing, right? So, and then you're going to find, uh, like, another items of technical debt, uh, which are going to force you to fix some of them, and then you're going to spend forever, uh, until you end up into the nice place again, and yeah.

join3r

That, that, there was actually a genius idea that, uh, some of the, I, I think, like, 10 servers maybe were running some old Red Hat, right, or something like that. And they were like, "Okay, if we are doing it right now, let's upgrade it," right?

Oh my God.

drunkez

That's the best. Yeah.

join3r

That was such a mistake, right? And I, and I didn't know about it anything, right? And I, and I'm just like, uh, I, I see the, the Jira tickets going, right? And, and a few of them are still there, right? And I'm asking like, "What's wrong with those servers," right? It shouldn't be that hard. Yeah, we wanted to upgrade it, but now we figured out that the database doesn't run on that, uh, those servers and-

drunkez

Yeah.

Valentin

Yeah.

join3r

It's, it's, it's difficult because you can't even, um- At, at least there we, we couldn't even, um, use it, right, to get the environment to a better level, right? Because you want to bring it up as soon as possible.

Valentin

Yeah.

join3r

So you are copying all the configuration files-

Valentin

It has

join3r

... everything wrong, right? After years or years of, uh-

Valentin

Yeah

join3r

... those systems running. Yeah.

Valentin

This is exactly, this is exactly the problem, right? Like, I have seen it time and time and, like, like, again and again. People have the impression that once, once you do some automation with Ansible or whatever, it's like, "Ah, it's one time job. It's going to work forever. Okay, I don't have to care about it anymore." No. No. You fix, you do it now, it will work for, I don't know, four months or until the next release maybe, or, or till the next package comes. And then you have to make sure that you always run it and test it in order to make sure that it's still running, right? Because, yeah, like this case, you're going to be dead, dead in the water. Yeah, so, yeah.

join3r

Yeah. R- right now what we are doing, for example, is we are running the Ansible, uh, automation on all the servers every night, right? And that essentially... But, but there is still,

until people can connect to the server, right, and do some hand configuration and fix something that's not, uh, inside Git, inside the, the, the Ansible repo, right, you're, you're gonna have issues, right?

Valentin

Yeah.

join3r

You're gonna have issues n- anyway, right? But, uh, like, I think the, it, it will be less issues, but yeah.

Valentin

I, I-

drunkez

Or pro-

Valentin

Yeah, go please.

drunkez

Yeah. Uh, I mean, I s- I saw it so many times actually that it's so cool running the automation who- whole pipeline from, from testing to delivering to deployment, whatever. But the problem with it is that a small glitch, right, small, uh, uh, like, not following the procedure completely, right, doing the small manual change there and there, like, can break your whole automation. Whole pipeline is, like, not usable anymore at all, right? You really have to, uh, commit any change, any small change, any dot have to be committed in a, you know, in a code or whatever that the pipeline can run it. I, I can see it actually myself. It took me quite a while, uh, quite a lot of time. I was building the templates, uh, through the Packer, through the, uh, Bitbucket CI to the Bamboo, blah, blah, blah, right? Uh, deplo- deploying them to vSphere. But I was testing them without all these pipelines, right? I, I did it, like, over the Packer and stuff like. And sometimes I was, I was, like, lost. W- what's the, uh, automation pipeline code and what's my code, right? Man, it took me quite a, quite a long time to distinguish this really correctly. Uh, yeah. Well, lessons learned actually, right? Once you got a, once you get, o- once you got a pipeline, use it anytime.

Valentin

I also learned something-

join3r

So many lessons learned through the years, right?

Valentin

Yeah. Yeah. And I learned something last, like, last year or last two years actually, after starting to do Kubernetes and having the DevOps role.

join3r

Mm-hmm.

Valentin

Uh, I think the word automation is used kind of incorrectly, yeah? Why, why am I saying this? What you do, what you do with, let's say, scripts or with Ansible on a server level, right, that's not really automation in my mind, right? Because that's somehow, like, um, infrastructure as code, let's say. Okay? Because automation, like we imagine it, like, really, like, uh, deploying a server, configure it, uh, from scratch with all the tools and, and all the software and do it, it, and do it forever and ever until the end of time, that's something which you can really do to the real extent in something like Kubernetes with manifest files, with helms, with everything. That will really build from the image level, that will deploy the pods as you want them. They, it will configure the network, the, like, you can run it 1,000 times and it will be okay if your cluster is okay. But what you do with Ansible, it's a bit different, okay? It's not automation to the, like, true extent of the, of the mean, right? In, so in my opinion, right? Of course, you install packages and you configure stuff and everything, but you're always, like, at the mercy of either the distribution which you have, which you use, like, uh, I don't know, Red Hat, DBN, whatever, right? And second, at the mercy o- of the server. If someone somehow did something manually and you don't know it, and then-

drunkez

Yeah. Yeah

Valentin

... maybe you could-

drunkez

That's a, that's a, that-

Valentin

Yeah

drunkez

... that's a very good point actually. I heard about some companies that, that, uh, that they were considering the, I mean, they were monitoring the logins through, I mean, interactive logins through SSH or whatever daemon they're running, and they're considering them as dirty, uh, since someone logged in.

Valentin

Yes.

drunkez

And they were marked as to be rebuilt, right? I mean, once you can fix the, I mean, okay, there is emergency problem, I'm gonna fix this, right, manually. So making, uh, going to the servers interactively and doing some change, okay, it's fixed for now. But the system is marked to be rebuilt, and that's so cool, right? Because any part of the system which is running and delivering some service, uh, was, uh, was kept by, by automation. Any, anything, right? That is so cool. I mean, this approach was very, it's hard. I, I think that especially developing and testing it, so very hard. But man, this is, this is a relief. That's so cool, right?

join3r

Yeah. Yeah. That's, uh, the, I, I think the major cloud providers have it like that, uh, their infrastructure.

drunkez

Yeah.

join3r

I think, uh, AWS, at least part of it is, is handled like that.

drunkez

Yeah, yeah. It was something, yeah.

join3r

You still, you still have those externalities, uh, right, which you don't if you use Kubernetes. You still de-depend on the, on the packages from, uh, from-

drunkez

Vendors. Yeah

join3r

... f-from, from the vendor, right?

drunkez

Yeah.

join3r

You still to, to, to some extent de-depend on the... I, I, I don't know, for example, you upgrade the, the server, right? And might be that something change, right, something, uh, unexpected-

drunkez

Yeah, but I-

join3r

... some package got... Yeah

drunkez

This is just a matter of testing, right? That's why you have the cloud images, right?

join3r

Yeah.

drunkez

I, I mean, they are... I, and I think this is the point where I read about the nice topic about, I mean, the slowly operating systems and Linux especially, but I mean it's Windows, are, are shifting towards this, uh, this, uh, state. We don't like to, we- they don't like to offer like RPMs and the, the, the, um, uh, the repositories you can fetch any software and configure as you want-

join3r

Mm-hmm

drunkez

... because it's just m- it's just raising the complexity of the problems you have to solve, of course. There is a multi, um, zillions, it's, it's geometrically growing the op- the, the, the, the combinations of a problems you can face.

join3r

Right.

drunkez

So they're going to RPM OS trees, they're going to the pods, they're going to the cloud images when they're, like, s- pretty much static.

Yeah. And this is even... I mean, I, I like this approach. So go with the development, go with the system you can, like, modify on your own as you want. But i-if you want to go with production, here is a well-defined, well-tested, well quality, uh, assuranced-

join3r

Yeah

drunkez

... system, right? So, and yeah, use it. This is tested. I mean, this is, this is, uh, the, the way the, the vendors are going in my opinion. So because I, I see the same, if you ha-have a multiple versions and you want, like, like Vali said, you have a Ansible playbook and you have two options. If you... Either it will be simple, but you have to do it specifically for your, uh, statical deployment,

or it will be super complex because you have to check everything in a Ansible code. Well, test everything. Do, uh, is this condition as I wanted, is this, this condition as I wanted? And I think it's just way better to have a well-defined deployment environment and use the simple, simple Ansible, for example.

join3r

Yeah. De-definitely, right? But, uh-

drunkez

Yeah

join3r

... what, what Valentin was saying that in Kubernetes, right, you, you pretty much have the environment defined in those, uh-

drunkez

Yeah, yeah, yeah

join3r

... in those YAML files, right? So, but, but, but still, right, if, uh, I know for example, uh, I'm, I'm not exactly sure, but I think, uh, one... I, I've heard that one company wanted to move from AWS, uh, to Google Cloud, and, and I think they were running everything on Kubernetes and, and stuff like that, and I think it was a c- it, it was a fairly, um, a painful-

drunkez

Task

join3r

... uh, yeah, yeah. It, it, it will, it was pretty painful. So even if you apparently, right, even if you have those YAML files and automation on, on one environment, it's not like, yeah, we can now go to Google Cloud because it's, uh, it's a little bit cheaper. Uh, it, uh, it's, it's still-

drunkez

Yeah

join3r

... sticky. Yeah.

drunkez

It's still sticky. And yeah, if you want to migrate, let's say, from EKS, uh, so, uh, uh, EKS to, uh, Azure KS, right, to Azure Kubernetes or to Google Cloud, right? Uh, so Google Cloud is the shittiest of the clouds, let's say for now. Uh, so this is the, the, the reality.

join3r

Hey, finally we've got some spice here. Let's

drunkez

It, it really is, uh, like on term of, of the, let's say, uh, options which we, you, you can have on terms of the features in, even in term of pricing. Yeah, so it's really the, let's say the last-

join3r

Pricing? Really?

drunkez

Yeah, yeah. Microsoft, for example, discounts heavily if you have some a- some enterprise agreements with them, and-

join3r

Oh, I see

drunkez

... and, and Amazon does it the same. Yeah, so, uh, Google is the last one, let's say, on the block, and yeah, they're not really competitive. They really stay behind. Yeah. But yeah-

join3r

Okay. But I think, I think the, the market share, market shares confirms this, right? I mean, they have the lowest share, for sure.

drunkez

Could be, yeah.

join3r

Yeah.

drunkez

Could be, yeah. So-

join3r

Yeah

drunkez

... so I, I ha- I haven't checked it on the, from the market share point of view. I checked it from the, let's say, from the technical point of view, and yeah, it's not competitive as, as the others. But yeah, Kubernetes is really amazing from the point of view of doing automation, like I said, from scratch, re-real automation. But of course, it's a pain in the ass if you need it for small projects. If you have like one website and/or one small app-

join3r

That makes sense

drunkez

... and, and you want to use a, a Kubernetes cluster just to maintain it and make sure that everything works, you're going to be dead, right? Like, it's not for everyone, but at the same time, yeah, uh, not all clusters are the same, are equal. Yeah. Because, yeah, let's say you have something running on VMware. You, you have this Tanzu stuff. You have running on Amazon. Yeah, you can't just, you can't just go, "Oh, yes, let's take my files from here and make it work on, on Amazon." No. That, that, that will not work, okay? Because you have versions, you have... Versions are really everything in Kubernetes. So if you use some specific version for some service or for some gateway or API or for whatever, uh, depending on the versions, you're going to have features working or not. So yeah, you always have to version match or to see if you can go to the next version if some stuff is deprecated or not, because there are so many changes in Kubernetes that, like, it's constantly changing. Like, and you have a lot of plugins which you can use. So it's crazy, okay? So you have a huge selection of services which you can deploy

Valentin

But yeah, you need to spend all your time into a code editor and look at the YAML files and really try to understand. And sometimes the errors which you get, which you get back, they're like crazy. You, you really can't understand. And if you really haven't spent a lot of time, it's crazy hard, yeah. But still, it's still amazing for automation in the real sense of automation and not just, uh, okay, let's configure a service, and that's it, okay? Yeah. But this changed, yeah, this changed for me because I was considering, let's say, Ansible, uh, and some other, let's say, services like, uh, SaltStack and everything, like real automation. But in the end, they're really not. Yeah, they're like just part-time automation, yeah.

drunkez

Well, I, I, I'm not sure whether, whether I agree or not. I mean, I definitely don't agree, but I, I'm just thinking w- into which extent because, uh,

it's just the way what do you automate, right? I mean, it's so-

Valentin

Yeah

drunkez

... cool because, I mean, I mean, uh, what, what I do, I'm fully automating part of... Uh, not part, but I'm fully automating the deployment of virtual machines and the services on them. Uh, and I do it really, like it should be completely unattended. Like you just click the button and just wait. And, uh, it's the, it's the, it's, it's completely automated to that extent because it's well-tested, right?

Valentin

Mm-hmm.

drunkez

So, and

we actually can do redeploy the actual state as well.

Valentin

Yes. Okay.

drunkez

Uh,

but yeah, I mean, the Kubernetes got its own because it's sort of the abstraction layer.

Valentin

Yeah.

drunkez

You don't care about that much about, uh, infrastructure behind. Of course, you just mentioned it. Yeah, you have to. If you will s- like fulfill some requirements, I'd, I, I would bet that it will work anyw- anywhere. Should-

Valentin

Mm-hmm

drunkez

... right?

Valentin

Depends on the complexity of the cluster, right? And what kind of services you, you, you have and what-

drunkez

Yes, of course. But I mean, this is-

Valentin

Yeah

drunkez

... this is the specification issue, right? If you will ful- fulfill the specification, it should run.

Valentin

Yeah, sure. Yes, yes, yes.

drunkez

Yeah.

Valentin

Yes.

drunkez

Yeah, it doesn't matter where.

Valentin

Yes.

drunkez

Um-

Valentin

So, yeah. If, if the specifications are in place, uh, the features are there, like everything should be okay. Yeah.

drunkez

Mm-hmm.

Valentin

And if the hardware matches, then yeah. So matches from the point of view of the resources, yeah.

drunkez

Yeah, yeah. Sure.

Valentin

But other than this-

drunkez

Of course, yeah

Valentin

... you don't care about the TV

drunkez

That's big, that's, that's actually quite interesting issue, right? I mean, the res- uh, because it's hard to measure what the resources do. Because now in these days, like everything is oversubscribed and, uh-

Valentin

Yes

drunkez

... everything is, um, abstracted somehow.

Valentin

Yes.

drunkez

And it's, it's su- It's, it might be very complex and complicated to get a, a good overview about resources you really need. Not just space, not just space, but also the, the, the speed you require from the, for example, storage backends, specifically the IOs, uh, the AP- API, uh, throughputs, and stuff like that.

Valentin

Yes.

drunkez

Right? It's really hard to get a good estimation.

Valentin

We, we did this. We had a large number of dashboards in Grafana for this.

drunkez

Mm-hmm.

Valentin

And we were doing this cal- this kind of calculations to see how much we can oversubscribe and, uh, yeah, how much are the clients actually using and allowing them.

drunkez

Mm-hmm.

Valentin

Uh, so they were requesting the resources. They were committing, and after a commit, it was approved or not.

drunkez

Mm-hmm.

Valentin

And yeah, the build process took it from there and allowed them, of course, the new quota, yeah, for CPU's memory or whatever, right? But yeah, this process of monitoring all the time, uh, how much resources are actually in use per work node, per, uh, or let's say per client, per application, right?

drunkez

Mm-hmm.

Valentin

It was different because you have names. So you have this namespace, right? You, you have a namespace for each client, uh, which is, yeah, can be per project, let's say, or you can have even multiple projects in there, right? But the, the idea is that, yeah, it was hard to keep a track, uh, like a meaningful track of the resources and not get lost into it.

drunkez

Mm-hmm.

Valentin

Because you, because you, you have so many, so many worker nodes, you have so much memory, you, you, you have so much oversubscripting. And yeah, sometimes you c- can't understand the numbers even if they're in front of you because you don't know how much you, you oversubscribed or not. Like it's a, it's a bit not making sense after some point after you, you, you have like 20 clients or 30 clients in, in there, and they are always having some sort of project in there. The numbers are so, so big and so like confusing, yeah, that, that sometime it's not making sense.

drunkez

Yeah. I agree with that.

Valentin

And we ended up always changing the dashboards because, oh, wait, now it's not making sense because we overcommitted with four cores, uh, and then we real- we really give them two, but they see four, and yeah. Uh, so this kind of stuff always happen, yeah, so we spent a lot of time in, in Grafana to come up with these huge dashboards to get the real, like a real, uh, state of the cluster, yeah.

drunkez

Mm-hmm.

Valentin

Because if, if, if you overcommitted too much, then some client will die. Yeah, some, some application will be unable to start. Some ports are just not starting, and then you, you have the customers just asking, "Why is it not starting? I'm doing everything right. I have it like in place, but it's not running." Yeah, so.

drunkez

Yeah. Yeah, yeah.

Valentin

But yeah, it's, it's for sure not, not black or white, right? This is totally true, like, but yeah, I believe the word automation is a bit too, uh, too, too, um, easy, too easily used By people like with, ah, so I just have a script and this is automation, okay? Or I just have an Ansible playbook to install a package and this is automation. I don't believe it's really, really automation, right? It's maybe some part it's automated or a small part, but you still have a long way to go until you can really say it's automated, yeah.

drunkez

Yeah.

Using Red Hat at company?

Valentin

Uh, no. So I'm sure it's used, it's used, but in my case, no. Um, I don't even have that much touch with the, with the VMs. Depends, yeah. Uh,

depends on the use case, okay? So we, we can use something from Ubuntu, uh, Microsoft. It depends on the, on what kind of services you have, right?

drunkez

I mean, I was ju- I was just asking because, uh, if you, if you are following this open source Red Hat drama-

Valentin

Yeah, I know the scandal. Yeah, yeah, yeah, I know.

drunkez

Yeah, yeah. And-

Valentin

I heard it yesterday, yeah. So I heard it ye- so to be honest, okay, just to take it like, li- like this. I heard so much. So over the years, I have been watching the, let's say, the Linux U- News forever, right?

drunkez

Yeah.

Valentin

So since I can remember. To be honest, at the end of the day, Red Hat is a commercial company which is making money, which needs to make money. And from all the experiences which I have seen in the past, open source and, uh, free software, which is also open source, most of the cases, let's say, it's not making money, okay? And people have the tendency nevertheless to bitch about it and say that, "Ah, this is not working. This is shit. This is whatever." But they still are not willing to pay anything for it at the end of the day, or mostly n- or most of them not paying anything. But still, they have a, like, always demands, and they have a l- like, high expectations from it. And at the end of the day, I think Red Hat realized that they can't just give the stuff which they give commercially free. They just remove all the branding, and then some Joe guy comes and offers com- uh, like, commercial support to the company which installs Centos upon.

drunkez

Okay, okay. You can, you can easily say Oracle.

join3r

Yeah, you don't have to- ... to mention Joe, right?

Valentin

So yeah, so it's Oracle, it's Joe, it's, uh, whoever company, right? So, so I think, to be honest, I think it's making sense. People don't like it. This is for sure the case, but, but, but Red Hat is a huge open source contributor. I think it has the largest numbers of projects which are, which they are participating in, and I think you have to realize that at the end of the day, people need to make money, and especially companies.

drunkez

Yeah.

Valentin

Like, so this is just my opinion, yeah.

drunkez

I, you know what? I, well, I was, uh, that reminds me something. When I was, uh, years ago, there was a guy, and we were thinking about, yeah, g- exactly, going with some kind of, it was the Puppet. Everybody knows Puppet, right? And it was like the, the, he was sort of a Puppet user, but also part- partially developer. And we were discussing this, "Yeah, man, uh, what, what, what will, what will be the next steps? Are we gonna use Puppet for sure or not?" And we said, like, company decided, no, we want, like, something we do, we, we can sign the SLA for it. We do, you know, so it was a pretty much closed, uh, product, which do the same, dashboards, automation, orchestration, blah, blah, blah, right? And we were like, "Man, that's, that's bad," right? I mean, for this, such amount of money, we could like, like really, like, hire some developers which would develop it and then send it to the upstream,

and we would be using the project whi- which will be just best. Uh, sorry, not best, but better, right? Because we would, like, pay the developers. We don't care that it's not gonna be just for us. It's gonna be upstream. But I mean, it was, this was this community approach, right? And I was thinking, you know, what about what, the Apache? Apache is, uh, the foundation, I think. And if the Red Hat is big, I think the Apache is also big. They have quite a lot softwares, open source softwares, but this is just the foundation. And I think they, they have these, uh,

customers, but they're not customers. They're, like, really volunteerly paying f- to the, to the, to their foundation because they understands that by making donations, they're making the software better, and it's then better for them as well.

So

yeah, that's a different, different example of how the open source could work. I mean, the Mozilla is driven by, as well, the community, I think, and they have their sponsors and stuff. Of course, there is a commercial part of the Mozilla group.

Valentin

Yeah.

drunkez

But the development is being driven by the foundation or something like that. I'm not sure. But, uh,

you know what the problem is with the Red Hat and stuff? Like, because the, uh, again, this is not the white, uh, this is not the white and, uh, the black, right? I mean, it's still between. But Red Hat is now on a different side, but by, by they, their decision, and they're, like, pointing to the companies. Uh, but the, uh, the Red Hat did the same in, in, in the beginning, right? This is a company that took the open source and made business out of it.

Now the question is, what is the way of making this business? Because Red Hat probably did a different way. They took to the open source, they offered the paid support. They are not, they were not like, uh, selling the open source software. They were selling the support and, and knowledge and, and everything like that, right? And I think even these, in these days, the Reddit is al- this saying that, yeah, by the, by the, um, signing the contract with us, you are getting mo- at first stage, I mean, first point is getting the best support you can get around the clock with the best engineers, blah, blah, blah, securities, blah, blah, blah, right? And I think theee, probably the Oracle is not doing it.

So I think I, I, I'm closely, I'm, by, you know, it depends on what I, what article I'm reading, but, but at least the last few days, I'm on the Reddit side somehow. I don't know how this happened but I am really. I, I think I understand them, right? I mean, there are companies, major companies, that they're just

doing nothing. Just

... I don't know how, what's the correct word, but I mean, they're j- they're just not contributing at all-

join3r

Stealing

drunkez

... pretty much. I don't want to use stealing, but this is not steal. This is still business, but the d- but the d- but it's the business doing bad way, right? I would, I would think like something like this be- yeah.

join3r

I, I, I have a question for you, Valentin. You said that it's a company needs to make money. Did you think, do you think that before that this decision, they didn't make money? Or is it more that they want more money, right?

Valentin

They always, they always made money, right? And this was never the issue that they never made money. But the problem when you're, usually when you're a corporation is that you have shareholders and you, if, because you have shareholders, you always need to, to, to make more money, and if the money sources are not enough and your growth is not enough, you have to cut where the problem is or try to close some of the, uh, gates, right, in order to make more money. This is a typical, like a typical approach, right? And this discussion of the CentOS, it was always a problem in Red Hat. It was always because they're, they always had the fight internally with the legal team because they, and sales because they never agreed and liked that they have CentOS and they offer CentOS for free, and on the other side, you have the Red Hat which you needed a subscription for and everything, yeah. So, but this, so, so as I said, I still believe even if you like it or not, companies need to make money because if it's not making money, it's not, it's not feasible. It's not viable, right? This is one of the bigger problem which you have now with these startups and all these US companies, right?

join3r

You are right. I'm not saying that companies shouldn't make money, right? The, the difference here I think is, uh, that they were ma- they were making money, right? Because I, I, I feel that they trans- transitioned as, uh, as Dusan said. They were f- fir- first they were selling support, right? And I, and I feel that that somehow slowly started to move towards, okay, we are selling software, right? Uh, you are, you are, you, you can, you can get, uh, Ansible Tower, you can get,

uh, uh, I, I forgot how their, um, the-

Valentin

Satellite

join3r

... uh, satellite, wh- wha- whatever. There, there, there are multiple tools like that.

Valentin

OpenShift.

join3r

Right. OpenShift, yeah. That, that's the one I was thinking about. You, you can have the free version, right? But the real good version, right? Yeah, that's-

Valentin

Yes

join3r

... that's not, that-

Valentin

Yes

join3r

... that's not something that you will get for free and it's open source and you can, you can install it on your home computer, right? So they are slow- slowly moving t- towards the point that, okay, we are selling, uh, software, right?

Valentin

Yes.

join3r

And, uh, I, I'm okay with it. I, I, I know it's their prerogative to do that, right? It makes sense. They, they are a company that they, uh, they have, uh,

they, they essentially have, uh, by law, right, they, they need to, they, they need to grow and, and, and pay money to the, to the investors and stuff like that, right? So, so I understand that.

Valentin

Yes.

join3r

But it still, uh, creaks me the wrong way-

Valentin

Yeah

join3r

... right? Because th- they were the good guys, and they are changing to the, yeah, they are not one of us, right? They are, they are the, they are the, the, the faceless company that needs to make money even though, right, the, the idea, I- the ideology of, uh, of the open source, I, I, I feel was damaged by this step. Do you agree there?

Valentin

No.

join3r

No?

Valentin

I'm going to, to tell you what the real problem is in my opinion, okay?

join3r

Okay.

Valentin

The problem is the mixing of the open source projects, because you, you have these huge companies which call themselves open source, right? Which they say, "We don't sell software. We sell support," right? And then they end up selling software also, and support of course. And the problem is that most of these huge projects are composed of thousands of libraries which are open source, which are built by-

join3r

Yes

Valentin

... Vali or join3r or Dusan or-

join3r

Lovely

Valentin

... Joe, right? These small, these small developers, this one guy, man show or two or let's say 10 of them, and they don't have a company. They don't have a business or whatever. They build it because they like it or they needed it. And this gains huge popularity, and it's ends up used by all these huge companies. They don't give pretty much anything back. They end up incorporating this software in all their products, or most of the ones which make money, and yeah Then they say, „Okay, w- this is our product, we sell it and... But wait, wait, wait. Wasn't this using also this, this, this, this?" „Yeah, sure. But it's okay. It's under the, the li- the right licenses." I don't know, BSD license or GPL or AGPL or LGPL or whatever license, right? And it's okay, we're covered, right? It's, it's totally fine. I think that's the problem because, because you, because you give the impression to people that, ah, we are open source, we take all these products and we still have an open source product for you free to use. But now it's not like this because, wait, maybe you can use it, but if you don't have a subscription, it's useless, right? It's, it, it, it's useless. You c- you can't really have it. And CentOS is, like, exactly like the same. And now they also had this scandal with, with, with Fedora and stuff, right? And also the Facebook is another example. Google is-- So all of these huge companies, because they pretty much in, like, swallow up all this, all this open source work and they end up incorporating it into their own, they end up making a ton of money with their products and with their support and whatever, right? Using a lot of open source software which never gets anything back. Yeah, and this is why there was so much d-drama, if you guys can remember, like one month ago or two months, three months, from developers, like some Node.js libraries. Uh, I'm going to make this not work because I can't live anymore, and I don't have the money, and I have kids and family, and nobody's supporting me with anything, and, and I can't just do it anymore. And like, you also had the, the, the drama with NTP, right? Like, you also had the drama with, uh, OpenSSL or with LibreSSL. So this, you find that, ah, wait, ah, there, there's only one guy behind, uh, like OpenSSL. Ooh, I never know it, but, uh, you know, I ha- we have been using it in our certification, uh, software for the last one hundred years, and it work. We made, like, billions of dollars, but yeah, we n- we never knew that there was only one guy. Yeah, I think that's the real problem, right? So yeah, companies will s- will always chase profit. This is normal. And most of the companies don't have any kind of, uh, let's say, uh, conscience, uh, and respect for the amount of money which they should make and the amount of profit which sh- they should give back.

drunkez

Yeah. Capitalism.

Valentin

And this is it. Yes.

drunkez

Totally.

Valentin

Yes, yes, yes. And this is turning more and more.

join3r

Yes, but, but Red Hat was one of the good guys in, in the past, right? It's, it's, it's f- it's for, for many years, it's no longer the, the, the, the feeling of the community, I, I feel, right? Yeah. I, I call them for how many years? I call them real Hitler, right? S- since we were working in, uh, in, in Drive together. So it's, it's changing, right?

Valentin

Yeah.

join3r

And, and I think, uh,

what's, what's interesting to me is, right, that they, uh, as, as you said, they, they give back a lot o-of code to open source, right? Um, but I wonder if, if this is, uh, a good step for the future, because right now, right, the, the, the near term goal is quite clear. It's, it's a good step towards, uh, getting more money, essentially, right? But, uh, in the long term, I feel that, uh, f- for example, I know a lot of people, right, uh, in, that went to Red Hat because of that ideology, right? That, that they were good people, right? That were, that, that went there because they were saying, "Okay, I, I believe in, in Red Hat," right? "I think, uh, I believe in open source." I, and, and there are a lot of people like that there, right? And, and though I, I, I probably guess they don't, they, they hate it when they were bought out by I-IBM, right? And I think this is just another, another thing where, where I think they will ascend. I think they will lose some people over that, right? Maybe not in the short term, but, uh, in the long term, yeah. Maybe.

drunkez

That's, that's, that's definitely possible. Uh...

Valentin

I'm, I'm going to tell you something now-

drunkez

Yeah

Valentin

... which probably will bring me some hate, but after hearing-

drunkez

Again.

Valentin

So, yeah, like always, right? I always come up with the shitty comment.

drunkez

Yeah, like, like last time since you were here that all the, all the listeners were like, "Oh my God."

Valentin

Fuck this guy.

drunkez

Pitchforks, fire, everything.

Valentin

Yeah. Yeah, yeah. Uh, the, the problem is that I heard a lot of developers, open source developers, and I listen to a lot of podcasts, and to be honest, I believe open source, at least on the long run and medium, long, on, on the medium, so medium run and long run, it's a mistake. Okay? It's a mistake because people, most of them-

drunkez

Yes, you were right. There is a hate.

join3r

From Dusan right now.

Valentin

Yes.

join3r

Hate 3,000.

Valentin

Most of them, when, when they start using open source, so we're not talking about developing open source, we're talking about just consuming open source. They have like an inherent understanding or need or want that this stuff should be ro- uh, working forever, it should be supported forever, it should be free forever, and this kind of stuff, right? And I think open source, to be honest, even if you start an open source project, if you have in the back of your mind any kind of idea of making money with that stuff, it should never be open source. And I see time and time, like case by case, like, like a lot of open source projects start open source, but they always want to make money.

drunkez

Yeah. For ex... I'd, I'd... Yeah, go join3r, then I will be-

join3r

I, I, I have, uh, I, I, I will pile up on you, Dusan. I'm sorry. I, I, I think, uh, the- This is correct, but I think that there is also a way for open source to stay open source and to still be good. And I think that the answer to that is not the GPL license. It's not the MIT license. It's, it's the, it's the licenses that, that we essentially, uh, that the community hates, right? It's, it's, uh, it's like, for example, Redis went through the license change where it could no longer be used in AWS, for example, or, or other cloud providers that they felt were not giving back, right? And, and that might be some way of, of keeping the software open source, keeping the companies happy that they can make money on that, right?

And, and but, and, and still having some, some sort of in, in the license, right, you can use it at home, right? If you, if you want to use it in your home projects-

drunkez

Exactly

join3r

... we, where we don't get, uh, any money from you either way, right? Yeah, go ahead, use it, learn it, then you can perhaps when you like it, you can bring it into the company, and then that company can pay for it, right? Where it, where it is making money.

drunkez

Yeah.

join3r

So maybe there is some way there, right? To, to, to-

drunkez

Uh

join3r

... still, yeah.

drunkez

I am, I am definitely on the same track here because I think it's not the, the question whether the code is open or not. I think it's the matter about the usage because imagine what's the opposite of not open source? I mean, it's a closed source. Then you are having the project. You have no idea what's going be- uh, under the hood, right?

And, uh,

I, I think it's just better to have it open. The problem is that there is a misusage of the open license, somehow license open source code even in, in these days, right? I mean, this is a problem. Joiner mentioned GPL, right? And we have a GPL. The GPL in this, um, uh, in the stages when, when it's relevant to us is telling us that, yeah, any code which is used to, to develop another code which was licensed with the GPL has to be redistributed back, and it has to be public, right? It's, that's nothing bad on it, but it's not commercial license. It's not license that was actually meant to, okay, let's do business on it, right? This is purely developed, uh, educational license. To me, it sounds like educational definitely or, or, or something like that. And I'm totally that's, that's something I, I'm, I'm totally fine with it, right? Okay, if you do, if you do use this code or product based on this code commercially, like give us five cents back. That's totally fine with it, right? I mean, I mean, that's totally okay. I mean, if, if you, if there is a free water somewhere, just drink it. But if you're like, uh, pack it and selling that, no, no, no, just okay, give us something. It's totally okay with it, right? So I mean, the open source, I mean, it's not the problem with the sou- whether the source is open or not. It's the problem of misuses of licenses, and it's a problem that there is not balance in the, in the market. There is no rules which despite the fact that they are written, they're not being followed by everyone correctly, right? Even in, in this, uh, this in drama, right, there is this FOSS, which is, uh,

open source foundation, whatever, which take care of this. They think that they will sue the Red Hat, right? Why they are thinking that they should be immediately sue if they think that there is the GPL is being, uh, misused or, you know, there is a problem with the GPL usage, right? So there are the companies that tries to follow the rules. There are two companies that trying to watch whether the whole environment is okay, but they're just not act like that, and this is in my opinion a problem. So open source is fine. So I more agree here with the Joiner than you, Vali, because the... I mean, I found the open source as the best possible. I mean, if I would be, I would be a ruler here in this world, any code would be open source. Any. It just makes, you know, that's, that's just, uh, somehow makes the things better in how to educate, how to, how to, uh,

audit the code, right? This is a major problem. Of course, we are not living in the, in the best world, so there will be someone who will steal and try to, you know... And that's the problem, right? So of course, this is a patch. That's something like a patch. Yeah, make the code closed sourced, right? And this will be more painful for someone to get the code. But yeah, it's the same that you will rob into the offices and get the code from the, from the Git or whatever, right? It-- which is internal, right? Something, something, uh, there is a similarity, right? It's just breaking the rules somehow. Uh,

what the... Yeah. So that's, that's, that's, that's it. Yeah. I was just thinking, I mean, whether the, whether... I would be very curious. That's why I ask you, Vali, about it, right? What, what's the, what's the, um, opinion of the major companies, right, which are using? What, what will be their, um,

uh, next step in this, in this area?

So I, of course, I don't know, let's say, what kind of, let's say, opinions is, are at the management level because that's the level which actually decides, right?

join3r

Yeah.

drunkez

What kind of, let's say... So of course, they get feedback and information from the lower levels like, of course, the technical experts and all this. But at the-

join3r

Architects probably.

drunkez

Yeah. But, but at the end, in the end, like they decide, okay, we go to this, to this, to this, or to this. To be honest, I believe to get rid of some of this drama and a lot of confusion and to also change a bit the way

Valentin

People are using software in general and to have the expectations clear and the rules also be being able to be enforced somehow, right? To be able to enforce some sort of rules of guidelines. I believe actually the software could be closed source, and then you could give the open source the code actually to the people which really need it in order to audit, security audit, uh, perform what kind of testing on it, and that's totally fine. You could have NDAs, you could have some sort of agreements in place, and it's totally fine. But-

drunkez

But then you don't know if the code-

Valentin

Yeah

drunkez

... you're auditing is the same code which is running-

Valentin

True

drunkez

... in your CPU, right?

Valentin

But let me give you the shocker now.

drunkez

Yeah.

Valentin

Most of the users don't care. They don't care what kind of software they have behind. So they don't care what ... Is it open source, not open source? They don't care. If they can get it, they can use it, they can run it, they don't care. Okay?

drunkez

Yeah, but they do care. Second, after there is a problem with the code, you remember OpenSSL, right? Anybody who was using OpenSSL-

Valentin

Yeah

drunkez

... and n- not 20 years, for 20 years were like, "Yeah, this is a standard. There is nothing wrong with it." And then there was a problem, and each company, like everybody-

Valentin

Yeah

drunkez

... was like, "Man, what are we gonna do? We are compromised," right? So there was a audit, there was a blah, blah, blah, and you know this Debian? Uh, Debian got these reproducible builds. That is so cool. I mean, they got ... You know it, what is it, right? I mean, they have the, they have a code, but they have, they have, uh, packages, and then they are, like reproduce the, reproduce the builds from the code, and they're matching, matching whether the repo package is the same and which is reproducible build. Uh, and even they realized in the beginning it was a slow percentage, like slow, like low digits. They're, they're, they were, they were of course increasing towards, uh, through the time, so now they're like, I dunno where, quite high. Nearly 100%. But they were thinking, "Yeah, if we need to be ... If we want to be like, uh, trusted, we need to build this, m- like, trust source," and this is, part of it is the reproducible build. But yeah, I mean, that's maybe possible too, to like, like, keep the source code until, uh, keep the, keep the code closed until it is required to open it-

Valentin

Yeah

drunkez

... by law or whatever, right? But in the ... Yeah. The-

Valentin

So most of the users-

drunkez

Sure

Valentin

... are will, they will not care. This is my honest opinion.

drunkez

Yeah, yeah.

Valentin

And for the companies, it would actually be easier and better to not have a, uh, not have the open source code because ... So from the point of view of like they don't go to some websites, to GitHub, whatever, and they pull some software and that's it. No. I'm ... I can with 90%, let's say, confidence tell you that they would prefer to have a contract behind it-

drunkez

Yeah

Valentin

... to work with some, with some company, to pay them some money, to know what they pay for instead of having some open source product and, uh, yeah, they're not sure, well, is it going to be okay? Is it going to ... Like, this dependency hell and this library hell and this open source hell at some point where you end up, you're not sure what kind of licenses are, are breached because you're not sure if you really checked them, all of them, if they're still the same license, if they ... Okay, so it's, it's tricky to be honest.

drunkez

Yeah, yeah.

Valentin

I'm sure at least for companies they would prefer, like 90% of the time, to work with, uh, with companies behind it, to have the, the, let's say the support behind it or at least have an agreement that, okay, they paid for this, this is ... They are able to use it and so on and so on, yeah.

join3r

Y- you are saying that, right? But they have option of doing that. They can, they can use Windows servers, they can use, uh, everything closed source, right? But they don't want to do that. They want to run Red Hat, they want to run Kubernetes, they want to run the open source software that's, that, that's, uh, yeah, that's being, being made for the servers, right, and essentially. So I, I, I, I know for example for, that, that, yeah, of, of course, right, if you, uh, each time you go to, to GitHub and you add another library, right, you, you hate it. You are like, "Okay, who is doing this library? How many people are taking care of it? When will it die? When will ... How will I move to something different," right? Th- th- this is all, uh, really complicated. But the, the option is not there that, okay, I will go to a third-party company, right? Pay them some money so they, uh, so they sell me some product or, or, or make a product for me because a lot of open source, uh, like, what's the, what's the ... W- what, what can I use if it's not OpenSSL? Which company g- can I pay to get the, the feature set that I could get with OpenSSL, right? Which company can I pay to get feature set of Kubernetes, right?

Y- you, you can't, right? You, you are, you're-

Valentin

You can't because-

join3r

At least not right now, right?

Valentin

You, you can't right now, let's say, or not easily because it was, let's say, developed this way, okay?

join3r

Mm.

Valentin

The market went this way. It-

join3r

Yes

Valentin

... there was some sort of, let's say, trend at some point in time where they say, "Okay, open source is the way because this is what the people want," or whatever. But I believe now, I guess, more and more companies and people are realizing that this is maybe not the way to go. They see a l- l- also a large number of projects closing up the open source stuff and switching from the open source, and also people regretting, so like developers, right, regretting that they did this stuff open source. They should charge, like Dusan said, like one cent or five cents, right, for it and they would be okay. But n- it's really hard to switch from an open source and free product To something getting paid

join3r

Open source doesn't mean it's free

Valentin

It's, yeah

join3r

... either, right?

Valentin

So, so I said open source and free.

join3r

Oh, okay.

Valentin

Okay? So it's really hard to switch from an open source and free product to open source and paid product. Okay? It's almost impossible. So you either create version two, whatever, and then say, "Okay, guys, this is paid. From this version two you have to pay or game over." Okay? You can't use it.

join3r

Because that's the com- that's what they want, right? They c- they want to suck you in into the free product, right? And they want-

Valentin

Yeah

join3r

... to switch.

Valentin

Yeah.

join3r

And you can't have it both ways. You can, you can have it like, okay,

get this. This is open source. This is free, and we get a lot of exposure through that. Everyone, everyone is using it because it is free and it is open source, right? Two s- those two things, you already got the, the exposure from that. You already got a million users from that, and you can after that just say, "Okay, now it's paid, and now it's closed source," right? E- even if you, for example, you, you start developing version two. No, you, they are go- going to fork you. They will, they will, uh, they will continue with the open source product, right? But, but my argument here stands that, uh, if you, if you would have started with a closed source, uh, product with, uh, which is not free, you wouldn't get the traction that you would get from open source, right? And you can have it, you cannot have it both ways, and, and that's, that's partly the problem of open source, right?

Valentin

True. Then maybe start with s- I believe this is another problem, let's say, and another shocker. Maybe start doing products which people really need or care, and not just some bullshit applications or some bullshit projects which are somehow fairytales and you get a lot of money from venture capital, uh, and always have a loss at the end of the year, and you never make money, like Twitter, right? So- So, so start with, start with a-

join3r

That's a good one

Valentin

... product. Start with a tool which is actually needed, which is solving a problem, right? And if it's really going to solve a problem, then you will have a market niche, and you will have, uh, profit coming at the s- end of the year at second or third. If you don't have profit at the end of the year, second or third, then close the company or close the project and start something else instead of doing all this bullshit projects and, and unicorn startups, a billion, uh, dollars, uh, like, uh, like, like with these huge evaluations. And in the end they're, they're useless. Most of them are useless. Okay? Nobody really needs Twitter, and nobody really needs, uh, uh, I dunno, Instagram. Those are just like, like drugs or some candy to, to, to some extent, right? They create some addiction. They create some-

join3r

Yeah. I mean, this is, this is the, this is about the definition of the word need, right? I mean-

Valentin

Yeah, sure. So, but-

join3r

Yeah

Valentin

... yeah. But as I said-

join3r

It's just the ice hockey. I mean, this is just the ice hockey, right? I mean-

Valentin

Yes

join3r

... nobody really needs ice hockey, but yeah, still-

Valentin

So-

join3r

... 300 million people you- ... watch it and play it and whatever, right?

Valentin

But this-

join3r

Yeah, but-

Valentin

... hook and, uh, this hook and release, like, like, like, like you say, uh, catching them with the open source and free product, this is quite common. I think it's all over the place, but I don't believe this is the right way to go, yeah. This is just my feeling, yeah.

join3r

Yeah. Th- there are also some things that, for example, have, uh, have a large value if they are open source. For example, let's talk about Bitwarden, right? It's open source. It's m- it's one of the things that when I look at a password manager, right, I'm, I'm way, way less, um, um, moved to choose something that's not open source, right?

Valentin

Mm.

join3r

And-

Valentin

Yeah, security, security s- especially as y- I mean, by grouping, right, to the security you think about, okay, open s- open sourced it means, yeah, it might be audited better. It might be like going public with the code. Might be still get some benefit, especially in the security

join3r

And, and, and I'm not locked in, right? Because-

Valentin

Yeah

join3r

... that's an, at, at the end, right, if, if I, for example, uh, I, I trusted LastPass, right? I nev- never used that, right? But I, but I didn't have the, the feeling, okay, they were, they were shitty sec- they had shitty security, right, and didn't, didn't, uh, rotate the keys and stuff like that, right? That's not, not, not why I didn't ch- choose them, right? I didn't choose them because they were not open source. And, and I didn't choose them because, okay, now you can, you can export, uh, your passwords from LastPass and, and import them to a, to a third-party tool, right, to something completely different, right? But will it stay like that? Or will they-

Valentin

Yeah

join3r

... will they be like, okay, f- so in this, this one version it will, it will quietly break, and this new version they will change the format and this and this and this. And then I will end up in a position where I want to change the, the password manager because they, they got too expensive. I don't like the application, whatever, and I cannot, right? And, and I feel-

Valentin

Yeah

join3r

... that, that with Bitwarden essentially, uh, especially since they have, uh, they have multiple working implementations, right, this won't happen. And, and the same, same thing is, for example, with, uh, with Obsidian, right? It's ... I'm, I'm not using it because it's open source because it's not. It's closed source, right? But the, the data that I have there is open. I can, I can leave any day, right? I, it, I'm not being locked in, and that's, that's also a part with, in open source that's, that's valuable, right? And that-

Valentin

Yeah, yeah. There, there is a-

join3r

... for example, could stay there, and you could change the, you can, you could change the, the license, the licensing terms, and you would still get that, that benefit from open source that you are, you are not that locked in.

That's, that's funny, funny actually. I, I'm, by, by, by, uh, listening to you I'm thinking myself whether-

drunkez

I have ever heard about like something like, okay, is this product or solution open source? You know, when there is a meeting or architects or whatever you're thinking about, okay, what-- We have a problem and we need to find a solution. A solution would be a, a software or product.

join3r

Yes. Yes.

drunkez

And I, I'm, I'm thinking I, I never heard about it. I go, "Is this open source? Make it sa-" No. Like Vali said, like, "No." I can-- We have-

join3r

You, you are, you are right. That, that, that's not in the dis-discussion, yeah. I, I haven't heard it either. Yeah.

drunkez

No, no, never. Never, ever. I mean, I mean-

join3r

But there is discussion about lock-in, right? At least in-

drunkez

About what?

join3r

... in our company, there is a lot of discussion about lock-in.

drunkez

Yeah, yeah. I, I mean, and this is, this is the hidden agenda, right? Pretty much. I mean, this, this is like, uh, the open source yes, no might be a part of it, right? How easy w- how easy would be to shift over to something like that? I mean, is this, is this the API? Is this open? Because there is a lot of product with which, which API is hidden or not, uh, fully exposed, for example, right? So

I'm wondering, right, like, yes, open source might be definitely, uh, an advantage on some, on some areas, right?

I don't think it's a disadvantage at all.

join3r

May- may- maybe-

drunkez

For company, yes. For, for companies, yes. I mean, because they're losing something if there is someone steal from them. But I mean, this is not the problem they have open source. The problem is that some different company doing nasty stuff outside of like us.

join3r

I actually believe it's a disadvantage for the people, yeah, for the, especially for the people. That's the problem. Because as a company, maybe you can survive, right?

drunkez

Mm-hmm.

join3r

If they steal some por-part of the code, you can sue them maybe, or you can, let's say, afford to somehow re-recover from that. But as a one-man show, you really don't have a chance. If they steal-

drunkez

Yeah, yeah

join3r

... your code and use it in 1 million products and they make a ton of money, you will never be able to sue them, right? You can't do anything. N-ninety-nine percent of the people don't sue these companies because they know they don't have the money for it, and they don't have the chance.

drunkez

Yeah. They will just lose.

join3r

And even if you sue them, they have such an army of lawyers, they will keep you forever in, in, in court, and you will never get anything from it, right? So-

drunkez

This, this, this, this, this is like a good script for a movie, actually.

join3r

Could be, yeah. Could be, yeah.

drunkez

Yeah, yeah. The single, single developers use the, like,

put whatever big company there .

join3r

Oracle. Let, let's say, let's say the, the, the company that has the most lawyers, right? Let's say Oracle.

drunkez

Yes. With just pretty much lawyers and two maintainers .

join3r

Two developers, right? And, and all of that.

drunkez

Yeah.

join3r

And, and 1,000 lawyers.

drunkez

Okay, guys. Well-

join3r

Yeah

drunkez

... I would like to open another topic, which is super fresh. This is, this will be something new for our podcast because, uh-

join3r

Okay

drunkez

... we're, like, pretty much the last who informs about something that goes on in IT, but this time maybe we will be the, in a,

in, in the early stage of the, like, have you heard about Threads by Meta?

join3r

Uh, yes, yes, yes, yes.

drunkez

Yes. You see?

join3r

I heard about it's this Twitter clone, yeah.

drunkez

Yeah, so, so because you mentioned that, yeah.

join3r

You already have it installed, right? Because I, I think it comes out today or tomorrow. I'm not sure.

drunkez

I, I'm not sure, but I think-

join3r

I don't even have to think

drunkez

... I think... Okay, let's, what's Threads, right? For listeners, okay, the, the, the Meta company, you know the company that, uh, that now-

join3r

Facebook

drunkez

... oh, sorry.

join3r

It's Facebook.

drunkez

Yeah, Facebook.

join3r

They might change the name, but their practice and what they do stays the same, right? It's still Facebook.

drunkez

Yeah.

join3r

They are still

drunkez

It's still Facebook and Instagram and all of this, right? And they have announced, actually their CEO, the Mark, uh, yeah, with the sugar stuff, that he-

join3r

The Mark

drunkez

... yeah, yeah, the Mark, uh, announced that they're, they're, they're going to launch the M- the Threads comp-, uh, the Threads application, which is the Twitter killer.

So 500 characters long, uh, messages with a five minutes, uh, long videos is, uh, I think, uh, is, uh, right now the limits for the single, uh, post. And what is the best, I think, is that you can log in there with the Instagram account. So pretty much all of the Instagram users are there.

join3r

Yeah.

drunkez

You don't need to create anything, right? I mean, this is like what Google did, uh, years ago with the YouTube-

join3r

Yeah. Yeah

drunkez

... and Google Plus and everything like. So the Google Plus, the, the, the active users, like were, there were three. One-

join3r

Yes

drunkez

... one of them, I was one of them .

join3r

Yeah.

drunkez

But on the paper, there were like 2 billion users using the Google Plus because each, each Google account, so Gmail pretty much account, was also the Google Plus subscriber or user or whatever, right?

join3r

Yeah.

drunkez

So, uh,

I think, I think this might be, this might be actually a Go- uh, the Twitter killer.

join3r

To, so to, to, to be honest, Google is the worst company when, when it comes to keep projects alive.

drunkez

Yeah, yeah. That's, that's a different topic-

join3r

They kill like-

drunkez

... but you're totally right.

join3r

Right.

drunkez

You're totally right .

join3r

Like YouTube and, and Gmail are the... No, YouTube, Google, and Gmail are the only ones which somehow survived over all these years.

drunkez

From 300. From 300 products-

join3r

Yes

drunkez

... last three years, just three, these three .

join3r

So I'm not even using Gmail anymore, so the only Google product which I use is-

drunkez

YouTube

join3r

... YouTube, and, uh, maybe, yeah, and Google, yeah, s-so to, to search something.

drunkez

Like engineer.

join3r

But other than this, I moved, uh, and

Valentin

I wouldn't, wouldn't use any Google product, to be honest, because I would be afraid of getting-- of, of having it killed like in one year or two years. Yeah.

drunkez

Yeah, yeah, yeah. That's, that's a good, that's a good, good idea. Uh, just let me, let me put one more, uh, information about the Threads up. It's not gonna be available, I think, in Europe for a while at least because the Meta, the Facebook isn't, uh, really sure or they are not really sure about, uh, how to do, what to do with the GDPR and all the s- all the personal stuff. So they just said, "Yeah, we don't run it in Europe for now."

join3r

That's a good choice because I think European Union would go after them because-

drunkez

That's possible

join3r

... I, I, I think they have a very, very bad name in European Union. That, that's one, one part. Yeah.

drunkez

For a reason. For a reason-

join3r

Uh, yeah

drunkez

... let's say.

join3r

Then, uh, the, the, the second point is that, um, it wouldn't be the, the, the first, uh, litigation a-against, uh, Meta or Facebook from, from European Union.

drunkez

Yeah.

join3r

So, so it's a, it's a known entity. And, and I f- and I strongly feel that they s- they try to use their dominant position on the, on the market that they have-

drunkez

Yeah

join3r

... with Instagram to, to go into a slightly different market, st- to the short form with Threads, and basically, um, edge out a small company of only a few developers, Twitter, right?

drunkez

Yeah.

join3r

So...

drunkez

But Thre-Twitter got like three hundred and eighty hundred, uh, three hundred eighty millions users or something like that.

join3r

Um-

drunkez

Which I think-

join3r

Maybe

drunkez

... will be a peanut for, for the, for the Threads in a year, in my opinion.

join3r

In, in, in, Instagram is, in- Instagram is much, much larger than Twitter.

drunkez

Yeah, yeah.

join3r

Twitter is-- gets, um, gets, uh, a, a lot of, uh, y- news because of that, because a lot of people in news are on Twitter, right?

drunkez

Yeah.

join3r

And a lot of important and celebrities and stuff like that. But, uh, yeah, I've, I, I've heard that the Threads, at least on JoinIT Discord, there was some information that Threads will be on ActivityPub. Is that at all true? It doesn't sound true.

drunkez

No idea, man.

join3r

I, I doubt that. Okay.

drunkez

But it was, it was on our Discord, so it, it's pretty much-

join3r

So that's-

drunkez

... 114% true.

join3r

So, so no. But, but, but we were talking about that even if it would be ActivePub, uh, ActivityPub, um, it would certainly be all locked off, right? Just as through social and stuff like that. So it wouldn't be the part of the ActivityPub network. It would be-

drunkez

Yeah

join3r

... um, in, in its own separate, uh, corner. Yeah.

drunkez

Yeah. Yeah. With a special, special, uh, condition you have to fulfill in order to get like two API calls.

join3r

Yeah, yeah. Valentin, but, but you said something interesting. You don't use Google products, so you are, you are, you are like me, only, uh, w-with a little bit more hair, right? Uh, I'm still using Gmail. I find it incredibly difficult to, to, to leave because I have a thousand accounts and stuff like that. I try to, um, have them forwarded, for example, to, to my own, um, um,

uh, to my own DNS, right?

But I'm still on, still on Gmail. The, the mail still goes through them. Will you, I'll be able to, to move completely?

Valentin

Yes.

join3r

That's, that's awesome.

Valentin

So I also had like 10 domains used-

join3r

Mm-hmm

Valentin

... on the Gmail one.

join3r

Mm-hmm.

Valentin

So I had the, the business account. Uh, I was paying per user, per license.

So I had like two users or three users, and yeah. Um,

it's not making sense, okay? Outlook, so Office, yeah, is much more, uh, much more flexible when it comes to the licensing. It's you have access to much more products when you want to use it. You can use much more services, and they're much more easier to use than Google. Google is such a shitty implementation when it comes to using the accounts. You can't even use the business account for YouTube. So I had to create a, uh, like a personal account just to use YouTube when I already had the Google account, which is of course for business, right? Which is not making sense because wait, you're, you let me use the, the business account for pretty much everything else, but you're not going to leave me-- to let me use it for YouTube, okay? And you're going to force me to create another account and just switch profiles all day long in the browser and in the phone and... No. Just no, okay? It's just stupid. It's not making sense, and it's just crappy. Yeah.

join3r

But you had your own, uh, DNS, right? So it wasn't so difficult to, to move. And where did you move? We-

Valentin

I moved to Office, to Microsoft.

join3r

Okay.

Valentin

That's the best which you can have for now, in my opinion. The, let's say you can even have the license much cheaper than, than on Google. And yeah, to be honest, I realized that having too many emails, it's also not making sense, okay? So I had some emails which were used in some systems or s- or some accounts in the past, and I can't delete them, let's say. But I created just as a, as an alias, and they were, of course, also working, yeah. But they were not a primary email, okay? So the primary email was always used as a real account, and that's it, yeah. So this is how I ended up transitioning and moving, yeah. It took some time to migrate, but Microsoft uses a, you have a tool in there, and you can just connect the account, and that's it. So it will transfer the emails for you, which is nice. But at first, Google will Will screw with you when you want to export the data, all the data which you have in your Google account, like the bookmarks, like the, uh, photos. The photos are a pain in the ass. Yeah, those are the worst because you have these Google Photos and if you used it for backup, right, like on the phone, oh, you're going to hate yourself.

join3r

I dodged that bullet. Yeah.

Valentin

That's perfect because that's the most painful part, yeah. Yeah, because Google makes it a pain because they want you to stay on their platform, and they don't want you to leave. Yeah, that's it. But-

join3r

But if they will be open source, you know, they could be an export tool.

Valentin

No, no, no, because open source, like Dušan said, it's also... So of course, you can have open source the right way done, and you can have open source the shitty way done, right? So you can have it open source, but really not an portable data format or not a portable way of moving to something else. Yeah. So they could really screw with you in a thousand ways. And people are not always creating, let's say, migration tools or whatever for every piece of service or tool, right? They really have to have a need or want to, to, to do it, right. And yeah, if the company will screw with you with a shitty format or whatever or not an API, even if it's open source, then you're going to be pretty much in a bad spot, yeah. So-

drunkez

Let me, let me-

Valentin

Yeah

drunkez

... tell you about the Google Takeout.

Valentin

Yeah, I did it.

drunkez

Mm-hmm.

Valentin

Yeah. So I did it.

drunkez

Does it work for you?

Valentin

In my case, I had photos, like 200 gigs of photos. They limit the, the, the-- They split the number of files. The maximum file size was like 10 gig or something like this. Yeah, the session expires. If you start one download, you can start maximum of two, yeah. And, uh, depending on this, it will take forever. Yeah, so, so don't... So I did it. I had a lot of hours spent in order to move, but I did it, and I will never go back to Google. Yeah.

drunkez

Yeah. Yeah.

Valentin

So yeah. Um-

drunkez

On-once we can make a, we-- Once we make, we can make a, a solid, solid, uh, episode of our podcast just, just, uh, fighting about it, right? Because I'm the Google user for sure, and I, I would like strongly disagree with your, uh, Microsoft statements, at least at some parts.

But-

join3r

And I'm an Apple user, right. I, I, I have, uh, I have photos on iCloud, so yeah, it's, it's gonna be amazing.

Valentin

I also have the same.

drunkez

It will be great.

Valentin

So I have the photos on, on the iCloud, and I also have them on the OneDrive. So now they are in two locations to some extent.

drunkez

Okay. But I think let's wrap it up for today because-

Valentin

Yes

drunkez

... Vali got to, got to leave. Uh, thank you very much, Vali, for today's, uh, appearance. It was so cool to-

Valentin

It was nice

drunkez

... get you back again. Again, it seems that it will be soon, uh, you will be soon with us. So thank you, Vali. Thank, thank you, join3r, as well. I'm, uh, drunkez or Dušan or whatever you think, uh, I might be. You can find us on join it bo- join it bo- those online.

joinit.online o- and on our Discord. Pre ľudí, ktorí nás počúvajú aj v jazyku, ktorý nebol týmto dominantným, tak toto bola anglická časť s naším kamošom Valentínom, also join3r. Ja som Dušan alebo drunkez. Na Discorde nás nájdete všetkých pokope. Čaute! See you then, Vali.

Valentin

Čau.

drunkez

Thank you.

Valentin

See you guys. Bye bye.

drunkez

Bye.

join3r

Bye.

Valentin

It was nice talking with you. Bye bye.