Setup Thin Provisioning Volumes in Logical Volume Management (LVM) – Part IV

Logical Volume management has great features such as snapshots and Thin Provisioning. Previously in (Part – III) we have seen how to snapshot the logical volume. Here in this article, we will going to see how to setup thin Provisioning volumes in LVM.

Setup Thin Provisioning in LVM
Setup Thin Provisioning in LVM

What is Thin Provisioning?

Thin Provisioning is used in lvm for creating virtual disks inside a thin pool. Let us assume that I have a 15GB storage capacity in my server. I already have 2 clients who has 5GB storage each. You are the third client, you asked for 5GB storage. Back then we use to provide the whole 5GB (Thick Volume) but you may use 2GB from that 5GB storage and 3GB will be free which you can fill it up later.

But what we do in thin Provisioning is, we use to define a thin pool inside one of the large volume group and define the thin volumes inside that thin pool. So, that whatever files you write will be stored and your storage will be shown as 5GB. But the full 5GB will not allocate the entire disk. The same process will be done for other clients as well. Like I said there are 2 clients and you are my 3rd client.

So, let us assume how much total GB I have assigned for clients? Totally 15GB was already completed, If someone comes to me and ask for 5GB can I give? The answer is “Yes“, here in thin Provisioning I can give 5GB for 4th Client even though I have assigned 15GB.

Warning: From 15GB, if we are Provisioning more than 15GB it is called Over Provisioning.

How it Works? and How we provide storage to new Clients?

I have provided you 5GB but you may used only 2GB and other 3GB will be free. In Thick Provisioning we can’t do this, because it will allocate the whole space at first itself.

In thin Provisioning if I’m defining 5GB for you it won’t allocate the whole disk space while defining a volume, it will grow till 5GB according to your data write, Hope you got it! same like you, other clients too won’t use the full volumes so there will be a chance to add 5GB to a new client, This is called over Provisioning.

But it’s compulsory to monitored each and every volume growth, if not it will end-up in a disaster. While over Provisioning is done if the all 4 clients write the data’s badly to disk you may face an issue because it will fill up your 15GB and overflow to get drop the volumes.

Requirements

  1. Create Disk Storage with LVM in Linux – PART 1
  2. How to Extend/Reduce LVM’s in Linux – Part II
  3. How to Create/Restore Snapshot of Logical Volume in LVM – Part III
My Server Setup
  1. Operating System – CentOS 6.5 with LVM Installation
  2. Server IP – 192.168.0.200

Step 1: Setup Thin Pool and Volumes

Let’s do it practically how to setup the thin pool and thin volumes. First we need a large size of Volume group. Here I’m creating Volume group with 15GB for demonstration purpose. Now, list the volume group using the below command.

# vgcreate -s 32M vg_thin /dev/sdb1
Listing Volume Group
Listing Volume Group

Next, check for the size of Logical volume availability, before creating the thin pool and volumes.

# vgs
# lvs
Check Logical Volume
Check Logical Volume

We can see there is only default logical volumes for file-system and swap is present in the above lvs output.

Creating a Thin Pool

To create a Thin pool for 15GB in volume group (vg_thin) use the following command.

# lvcreate -L 15G --thinpool tp_tecmint_pool vg_thin
  1. -L – Size of volume group
  2. –thinpool – To o create a thinpool
  3. tp_tecmint_pool– Thin pool name
  4. vg_thin – Volume group name were we need to create the pool
Create Thin Pool
Create Thin Pool

To get more detail we can use the command ‘lvdisplay’.

# lvdisplay vg_thin/tp_tecmint_pool
Logical Volume Information
Logical Volume Information

Here we haven’t created Virtual thin volumes in this thin-pool. In the image we can see Allocated pool data showing 0.00%.

Creating Thin Volumes

Now we can define thin volumes inside the thin pool with the help of ‘lvcreate’ command with option -V (Virtual).

# lvcreate -V 5G --thin -n thin_vol_client1 vg_thin/tp_tecmint_pool

I have created a Thin virtual volume with the name of thin_vol_client1 inside the tp_tecmint_pool in my vg_thin volume group. Now, list the logical volumes using below command.

# lvs 
List Logical Volumes
List Logical Volumes

Just now, we have created the thin volume above, that’s why there is no data showing i.e. 0.00%M.

Fine, let me create 2 more Thin volumes for other 2 clients. Here you can see now there are 3 thin volumes created under the pool (tp_tecmint_pool). So, from this point, we came to know that I have used all 15GB pool.

Create Thin Volumes
Create Thin Volumes

Creating File System

Now, create mount points and mount these three thin volumes and copy some files in it using below commands.

# mkdir -p /mnt/client1 /mnt/client2 /mnt/client3

List the created directories.

# ls -l /mnt/
Creating Mount Points
Creating Mount Points

Create the file system for these created thin volumes using ‘mkfs’ command.

# mkfs.ext4 /dev/vg_thin/thin_vol_client1 && mkfs.ext4 /dev/vg_thin/thin_vol_client2 && mkfs.ext4 /dev/vg_thin/thin_vol_client3
Create File System
Create File System

Mount all three client volumes to the created mount point using ‘mount’ command.

# mount /dev/vg_thin/thin_vol_client1 /mnt/client1/ && mount /dev/vg_thin/thin_vol_client2 /mnt/client2/ && mount /dev/vg_thin/thin_vol_client3 /mnt/client3/

List the mount points using ‘df’ command.

# df -h
Print Mount Points
Print Mount Points

Here, we can see all the 3 clients volumes are mounted and therefore only 3% of data are used in every clients volumes. So, let’s add some more files to all 3 mount points from my desktop to fill up some space.

Add Files To Volumes
Add Files To Volumes

Now list the mount point and see the space used in every thin volumes & list the thin pool to see the size used in pool.

# df -h
# lvdisplay vg_thin/tp_tecmint_pool
Check Mount Point Size
Check Mount Point Size
Check Thin Pool Size
Check Thin Pool Size

The above command shows, the three mount pints along with their sizes in percentage.

13% of datas used out of 5GB for client1
29% of datas used out of 5GB for client2
49% of datas used out of 5GB for client3

While looking into the thin-pool we can see only 30% of data is written totally. This is the total of above three clients virtual volumes.

Over Provisioning

Now the 4th client came to me and asked for 5GB storage space. Can I give? Because I had already given 15GB Pool to 3 clients. Is it possible to give 5GB more to another client? Yes it is possible to give. This is when we use Over Provisioning, which means giving the space more than what I have.

Let me create 5GB for the 4th Client and verify the size.

# lvcreate -V 5G --thin -n thin_vol_client4 vg_thin/tp_tecmint_pool
# lvs
Create thin Storage
Create thin Storage

I have only 15GB size in pool, but I have created 4 volumes inside thin-pool up-to 20GB. If all four clients start to write data to their volumes to fill up the pace, at that time, we will face critical situation, if not there will no issue.

Now I have created file system in thin_vol_client4, then mounted under /mnt/client4 and copy some files in it.

# lvs
Verify Thin Storage
Verify Thin Storage

We can see in the above picture, that the total used size in newly created client 4 up-to 89.34% and size of thin pool as 59.19% used. If all these users are not writing badly to volume it will be free from overflow, drop. To avoid the overflow we need to extend the thin-pool size.

Important: Thin-pools are just a logical volume, so if we need to extend the size of thin-pool we can use the same command like, we’ve used for logical volumes extend, but we can’t reduce the size of thin-pool.

# lvextend

Here we can see how to extend the logical thin-pool (tp_tecmint_pool).

# lvextend -L +15G /dev/vg_thin/tp_tecmint_pool
Extend Thin Storage
Extend Thin Storage

Next, list the thin-pool size.

# lvs
Verify Thin Storage
Verify Thin Storage

Earlier our tp_tecmint_pool size was 15GB and 4 thin volumes which was over Provision by 20GB. Now it has extended to 30GB so our over Provisioning has been normalized and thin volumes are free from overflow, drop. This way you can add ever more thin volumes to the pool.

Here, we have seen how to create a thin-pool using a large size of volume group and create thin-volumes inside a thin-pool using Over-Provisioning and extending the pool. In the next article we will see how to setup a lvm Striping.

Babin Lonston
I'm Working as a System Administrator for last 10 year's with 4 years experience with Linux Distributions, fall in love with text based operating systems.

Each tutorial at TecMint is created by a team of experienced Linux system administrators so that it meets our high-quality standards.

Join the TecMint Weekly Newsletter (More Than 156,129 Linux Enthusiasts Have Subscribed)
Was this article helpful? Please add a comment or buy me a coffee to show your appreciation.

19 thoughts on “Setup Thin Provisioning Volumes in Logical Volume Management (LVM) – Part IV”

  1. Hi @Babin Lonston,

    What a great explanation! Thank you!. There is a typo in the command below. You wrote in the article that you created 15gb here 32 MB.

    # vgcreate -s 32M vg_thin /dev/sdb1
    
    Reply
  2. I am getting this error while creating thinpool. Do i need to install any package for thinpool and how?

    [root@rhel6 ~]# lvcreate -L 380M --thinpool mypool vg_thin
    lvcreate: unrecognized option '--thinpool'
      Error during parsing of command line.
    
    Reply
  3. Hi Babin,

    First of all thanks for putting this LVM management article together well.

    I could see that you have not done “resize2fs” after extending the thin pool size using “lvextend” command (Ref.: 3rd last screen shot).

    Could you please explain.
    a. Why it is not required to extend its filesystem although thin-pool is also treated as an LV ?
    b. Also, the same matter has been noticed for the snapshot LV too. Kindly clarify.

    Reply
  4. What could be the ideal size taken by Meta in case of thin provisioning. In my test environment I can see META % is growing fast. Are there any recommendation size we need to set for thin_pool_chunk_size or poolmetadatasize while creating thin pool.

    Reply
  5. Hi ,

    Could you please make me understand why -s 32M is used to create a vg. I am little bit confused.
    vgcreate -s 32M vg_thin /dev/sdb1
    Thanks

    Reply
    • // Could you please make me understand why -s 32M is used to create a vg. I am little bit confused. //

      Very easy one volume group (vgs) will be divided into multiple pieces that each piece with 32M size.

      // vgcreate -s 32M vg_thin /dev/sdb1 //

      Your creating the volume group from physical volume which have the each piece with 32 MB size of extend.
      So when you create a logical volume you can use the extend size.

      Reply

Leave a Reply to Babin Lonston Cancel reply

Thank you for taking the time to share your thoughts with us. We appreciate your decision to leave a comment and value your contribution to the discussion. It's important to note that we moderate all comments in accordance with our comment policy to ensure a respectful and constructive conversation.

Rest assured that your email address will remain private and will not be published or shared with anyone. We prioritize the privacy and security of our users.