when they want a scalable, high performant, deterministic and flexible language C or C++ is a good choice.
I don't agree completely with the scalable part
Ludovic 'Archivist'
Box of
But I'll shut up
Ludovic 'Archivist'
C++ and C do not scale so well
Mihail
I don't agree completely with the scalable part
Depends on what exactly you mean by scale
Ludovic 'Archivist'
Depends on what exactly you mean by scale
You may scale vertically, but horizontal scaling gets complicated
Mihail
But that's C++ iirc
Ludovic 'Archivist'
This is mainly due to the impossibility to reliably transfer machine code and data
Mihail
You just click s and then x, y or z
Anonymous
Hello
Ludovic 'Archivist'
Blender scales very well
Scaling means making an application use more CPU cores (vertical) or more computers (horizontal)
Mihail
Scaling means making an application use more CPU cores (vertical) or more computers (horizontal)
Oh I thought you were joking, so I did the same
Mihail
Nvm sorry
Ludovic 'Archivist'
Ah no I am very serious
Ludovic 'Archivist'
C++ apps tend to be hard to scale
Dima
yeah
Ludovic 'Archivist'
At least without a proper tool set
Dima
but a really large developed low level sdk can keep it up but that’s pain
Ludovic 'Archivist'
but a really large developed low level sdk can keep it up but that’s pain
That is what I code
Ludovic 'Archivist'
A completely asynchronous sdk for large scale C++ applications
Dima
scaling support by v or h?
Ludovic 'Archivist'
Both
Ludovic 'Archivist'
Near transparent scaling
Ludovic 'Archivist'
In an Erlang fashion
Dima
what about horizontal? like two machines are talking to each other using simple net layer?
Ludovic 'Archivist'
what about horizontal? like two machines are talking to each other using simple net layer?
I plan for about 8k machines
Dima
lol, but I am curious about the way they are talking
Dima
there’s one cluster host?
Ludovic 'Archivist'
It should scale up to that point
Ludovic 'Archivist'
It is a decentralized system, apps are to be divided in state machines that are startable by the engine
Ludovic 'Archivist'
You can make supervision trees to respawn a dead state machine on an other node
Mihail
It is a decentralized system, apps are to be divided in state machines that are startable by the engine
Oh so it controls the whole machines?
Mihail
That sounds interesting
Dima
so in conclussion there’s one master machine-like?
Mihail
It is, yet it is Unix only for now
I'd imagine that would be the primary OS that'll be used
Ludovic 'Archivist'
It doesn't use any part of the C standard library since everything is made by hand to be a state machine
Dima
oh
Dima
yes
Ludovic 'Archivist'
There is no master
Dima
yeah I got it
Dima
that’s interesting
Dima
I was planning to add clustering stuff to my web framework, kinda virtual actors, but as I read it requires one supervisor or I got it wrong
Ludovic 'Archivist'
Every node synchronizes with the nodes that should host the services they need
Dima
yeah, that’s very interesting
Mihail
And is there any specialization for the different machines or they all do the same thing?
Ludovic 'Archivist'
I was planning to add clustering stuff to my web framework, kinda virtual actors, but as I read it requires one supervisor or I got it wrong
It depends, I use an approach that is similar to Ceph: computation positions are calculated, not looked up
Ludovic 'Archivist'
And is there any specialization for the different machines or they all do the same thing?
No specialization, it is a cooperative model
Dima
I imagine how much memory it would eat if every machine would know about >10k friendly machines
Mihail
I imagine how much memory it would eat if every machine would know about >10k friendly machines
If they're calculated not much
Ludovic 'Archivist'
Each node have a Scheduler per NUMA band, they communicate using UDP in a way not dissimilar to QUIC and each node have a position in the cluster that is linked to its physical position
Dima
s c a l a b i l i t y
Mihail
I guess
Ludovic 'Archivist'
If they're calculated not much
Each machine takes a dozen of 64bit unsigned ints of space
Ludovic 'Archivist'
In the position cache of each other machine
Dima
I am really curious lol, so they have own kinda own “relation acknowledges” for udp, to make it reliable
Ludovic 'Archivist'
If one machine stops responding, it will get expelled and associated supervisors will restart the job on the machine they should start back on following a mathematical relationship
Dima
I got inspiration to start developing that stuff again lol
Ludovic 'Archivist'
The principle is named HARP
Ludovic 'Archivist'
For High Availability Ring Protocol
Ludovic 'Archivist'
It is my lil baby of a concept
Ludovic 'Archivist'
Ring hierarchy for distributed data storage : the HARP
https://archivist.nekoit.xyz/ring-hierarchy-for-distributed-data-storage-the-harp/
Anonymous
Dima
define
void input_data(….. above main
Dima
it clearly says
Anonymous
thnk you
Nicolas
Abuse.
Jeremy
Dima
oh yes it is, didnt see
Jeremy
always the small things, am I right?
Anonymous
Hi can anyone tell me c++ basic concepts
Anonymous
M from mechanical background want to know about programming.
Dima
wtf
Anonymous
😳
Dima
.