Tim's picture

I know several folks use proxmox, is anyone in using OpenStack yet?

I am looking for a solution that allows me to utilize 4x 1u dual quad core as an internal lab for development work. I currently have 2 quad cores running headless virtualbox and they both run like a champ however getting a new instance up does take a bit of time.

I have looked at all sort of solutions of the last few weeks and have come to Proxmox or OpenStack.  I have looked at CloudStack but I have yet to talk to anyone who has a working install.




Jeremy Davis's picture

(adrianmoya) But I don't know any of the details. He was using Proxmox too but AFAIK he hasn't looked back since he got OpenStack running. Unfortunately he doesn't seem to spend much time here anymore (although he's still floating about - I've spoken to him via email). You could try messaging him (via his TKL contact page) with a link to this thread  input and ask for his, I don't think he'd mind that.

I've been meaning to have a play with it myself, but Proxmox works really well for me and from what i gather the setup is a little more involved than Proxmox (which is a simple install from ISO).

If you do give it a go, be interested to hear how it works out for you.

Alan's picture

Check out StackOps, it's OpenStack for the most part and comes as an ISO..... I'm starting to get into it in my lab and getting away from Proxmox. Don't get me wrong, Proxmox is great for learning, but I'm looking for something more and from what I'm seeing, OpenStack is it! 



Jeremy Davis's picture

Sounds like its worth a look.

Out of interest, when you say you wanted 'more' what was it that Proxmox isn't providing for you?

Alan's picture

By "more", I mean that it seems that OpenStack (which is what StackOps is) has quite a bit more flexibility. Multi-Tier, Multi-tennant and a few others and I feel that Proxmox VE just doesn't have these features, or they're not as mature as I feel OpenStack is. 

I only have one server running and am waiting on a replacement MB to come in so I can finish my 3rd server, then I'll have a 3 server OpenStack cluster. I'm looking forward to learning this software and sharing my experiences at a later date.

Alan's picture

I've found something new.... I have now tried both OpenStack and CloudStack. Besides the install process, I can't tell much between the capabilities due to my smaller environment (just a home lab). But then I saw a blog post about a fairly new project. http://archipelproject.org/

I'm finally building my NAS out to where I need it and will start with this project fairly soon (probably a quick install this weekend). I really like the abilities that I see with Archipel so far.

Jeremy Davis's picture

Although I note that according to it's website "This is not a bare-metal solution. See it as a light weight agent installed on physical machines and a web interface you can install anywhere." So it could be used as an alternative interface for Proxmox I'd imagine (it supports both OVZ and KVM - the 2 VM technologies used in Proxmox). Otherwise you'd still need to build your environment (and doesn't look like it supports OpenStack ATM).

Alan's picture

This project has released an ISO (ANSOS) that can be used for "Agents." I haven't used this, so I don't know the depth of the project, but it looks like an entire infrastructure to me. Can't wait to open a chat session with a VM :)

Jeremy Davis's picture

But more of a demonstration. It is a Live distro only - which allows the saving of persistant data so it could be used but I don't think it is really intended as such (but perhaps I'm wrong?).

Personally I don't think you can go past Proxmox, especially since it now includes TKL OVZ templates for direct download from within the WebUI, but perhaps that's just me... I have been using it now for 3 or 4 years and find it rock solid. The v2.x interface is not quite as intuative as v1.x but is also much more powerful.

As for the things that you raised earlier with PVE, multi-tenancy has only just been added (as of v2.0 - last year) but I have found it pretty good so far (and this I think is partially why the interface has lost some of it's simplicity). I have a number of machines that are now administered by others and it works well. Assuming that by multi-tier you mean something like clustering (ie multiple physical hosts) then Proxmox has been doing that since before OpenStack was a project.

Did you test the performance of OVZ containers vs other forms of virtualisation? For me that's the killer feature of PVE, incredibly light weight OVZ containers for Linux and KVM for everything else (which works quite well). The PVE devs offer great free support too (via their forums and mailing list).

I'm certainly not suggesting that OpenStack is bad, but from my understanding it's aimed at a slightly different market. OpenStack is more for big enterprise, whereas Proxmox is more for small to medium enterprise (and I'm not sure where ANSOS fits...?).

Anyway like I say if you don't like the WebUI of PVE but do like the Archipel UI then perhaps investigating running Archipel on PVE may be a good blend for you?

Kumar Ullal's picture

How can this be possible?

Archipel requires libvirtd. Proxmox does not support libvirt.

Jeremy Davis's picture

I haven't but I would assume that you could just install it (like any other package)... Although perhaps there is a conflict? If so, I suspect that even then it wouldn't be an issue (because if you were planning to use Archipel then you wouldn't care if breaking the PVE management was required to set up usage with Archipel).

Obviously though if you did that (removed components of PVE) then you wouldn't probably have a lot of luck getting support from PVE should something go wrong.

Perhaps installing from scratch is a better option for you? If you use Debian 64 bit as a base then you could still install the PVE kernel (which AFAIK is the only project producing a kernel that supports both OVZ and KVM), but perhaps that's not important to you either?

Kumar Ullal's picture

I had asked proxmox a question regarding installing libvirt deamon on proxmox host. THey suggested it might break things.

So the only option left is to install KVM from scatch with libvirt. Then install openvz on the sam host.

Jeremy Davis's picture

But would it break KVM and OVZ? Perhaps it would, but there's only one way to find out!! Personally I'd test that before you go to the effort of doing a full install from scratch.

Unless you compile your own kernel then you're probably need to at least use the PVE kernel. I don't know of anyone else who produces a kernel that supports both KVM abd OVZ (all other kernels that I know of only support one or the other, and both KVM and OVZ require a kernel that supports them...)

The only other realistic option I see would be to use 2 separate physical machines - one for KVM and one for OVZ. Personally it seems like a lot of work to go to for a setup that you may struggle to find support for with a slightly prettier UI. Unless there is some functionality that is missing from Proxmox but included in Archipel?

John Kirker's picture

Here we are several years later...  Curious which path you took and where things are at with your network.  Hope to hear back.

Jeremy Davis's picture

I'm still using Proxmox and still loving it. I have now had some (brief) experience with OpenStack and found it quite painful, but in fairness I installed it nested (i.e. nested virtualisation) in my Proxmox server. And I installed it "all in one" (i.e. al;l services in the one VM - rather than then multi-node setup that they recommend for production).

IMO OpenStack is probably a great solution for large businesses and for hosting companies, but unless you have a ton of hardware laying around unused then IMO Proxmox is a much better solution.

Proxmox itself is quite scalable and you can have multiple nodes. However each node is a complete system that can run independently if need be; whereas OpenStack by design run different services on different nodes (although you can combine them, but they recommend that only for testing, not production). FWIW I know of at least one hosting company that uses a farm of Proxmox nodes...

A couple years ago, I asked on a forum here if there was a Turnkey Hypervisor and was directed at ProxMox.  Then TK and PM teamed up.  
From my company's work in OpenStack, it is quite complex and quite extensive.  It can do a LOT, but it takes a LOT to do a LOT.  ProxMox doesn't do as much, but it is SUPER EASY.  

I am considering going cloud for my next few projects, and I like some of the features of AWS, but not the cost.  I'm considering Digital Ocean, and putting a Docker image there, then putting everything in it.  Maby a hosting company using ProxMox would be good.  Anyone got a good, cheap cloud provider for a small start-up? 


John's picture

Thanks for the reply Jeremy... I've got it running now as well...  It's simple so I'm pretty happy.  I'm nervous about the next version update with a cluster as I haven't gone though that yet but overall it's been good.

MikeP - you need to add to your request for a referral:

"Anyone got a good, cheap cloud provider for a small start-up that can scale if the small start-up turns into something?"  ;)

Deepen Dhulla's picture

Proxmox 3 was not so strong. While Proxmox 4.x is great and stable. Todays its a 1 year I am using Proxmox 4.4 on 9 Rack Server , in Master-Master Cluster, with CEPH RBD block Sotrage of 16TB , in replication mode on it (*TB useable) , with 12 LXC & 4 KVM on it. with all data on ceph SDS.    and its stable, you can move LXC/VM from one physical server to another , and no issue of data copy its in few sec due to use of CEPH RBD block for Sotarge of LXC and KVM.overall proxmox has turn great.and has least maintenance too.  

Add new comment