PG-Storm: Let PostgreSQL run faster on the GPU

sql

 

PostgreSQL extension PG-Storm, allows users to customize the data scan and run queries faster. CPU-intensive work load is identified and transferred to the GPU to take advantage of the powerful GPU parallel execution ability to complete the data task. The combination of few number of core processors, RAM bandwidth, and the GPU has a unique advantage. GPUs typically have hundreds of processor cores and RAM bandwidths that are several times larger than CPUs. They can handle large numbers of computations in parallel, so their operations are very efficient.

PG-Storm based on two basic ideas:

  1. On-the-fly native GPU code generation.
  2. Asynchronous pipeline execution mode.

Below figure shows how query is submitted to execution engine and during query optimization phase, PG-Storm detects whether a given query is fully or partially executable on the GPU, and then determines whether the query can be transferred. If the query can be transferred, PG-Storm creates the source code for the GPU native binaries on the fly, starting the real-time compilation process before the execution phase. Next, PG-Storm loads the extracted rowset into the DMA cache (the size of a buffer is defaulted to 15MB) and asynchronously starts DMA transfers and GPU core execution. The CUDA platform allows these tasks to be executed in the background, so PostgreSQL can run the current process ahead of time. Through GPU acceleration, these asynchronous correlation slices also hide the general delay.

After loading PG-Strom, running SQL on the GPU does not require special instructions. It allows the user to customize the way PostgreSQL is scanned, and provides additional workarounds for scan/join logic that can be run on the GPU. If the expected cost is reasonable, Task Manager places the custom scan node instead of the built-in query execution logic.

The graph below shows the benchmark results for PG-Strom and PostgreSQL. The abscissa is the number of tables, and the ordinate is the query execution time. In this test, all relevant internal relations can be loaded into the GPU RAM on a one-time basis, pre-aggregation greatly reduces the number of rows the CPU needs to process. For more details, test code can be viewed (https://wiki.postgresql.org/wiki/PGStrom).

As can be seen from this figure, PG-Strom is much faster than PostgreSQL alone.

Here are a few ways you can improve the performance of PostgreSQL:

1. Similar vertical expansion

2. Heterogeneous vertical expansion

3. Horizontal expansion

PG-Strom uses a heterogeneous longitudinal extension approach that maximizes hardware benefits for workload characteristics. In other words, the PG-Strom allocates simple, large numbers of numerical calculations on GPU devices before running on the CPU core.

Evolution, Right…

23 thoughts on “PG-Storm: Let PostgreSQL run faster on the GPU

  1. One more thing. It’s my opinion that there are quite a few travel insurance sites of reliable companies that let you enter your journey details and obtain you the rates. You can also purchase the particular international holiday insurance policy on-line by using your current credit card. All that you should do is usually to enter the travel specifics and you can be aware of the plans side-by-side. Simply find the package that suits your budget and needs after which use your credit card to buy them. Travel insurance on the web is a good way to search for a respected company regarding international travel insurance. Thanks for discussing your ideas.

  2. you’re really a good webmaster. The web site loading speed is incredible. It seems that you’re doing any unique trick. Moreover, The contents are masterwork. you have done a wonderful job on this topic!

  3. Hi there, I found your web site by the use of Google whilst searching for a related subject, your site got here up, it appears to be like good. I have bookmarked it in my google bookmarks.

  4. Wow, fantastic blog layout! How long have you ever been running a blog for? you make running a blog look easy. The overall glance of your web site is magnificent, let alone the content material!

  5. I think other site proprietors should take this site as an model, very clean and great user genial style and design, let alone the content. You are an expert in this topic!

  6. Thanks for your content. One other thing is that if you are disposing your property all on your own, one of the troubles you need to be alert to upfront is how to deal with household inspection accounts. As a FSBO seller, the key towards successfully moving your property and saving money about real estate agent income is awareness. The more you know, the softer your property sales effort might be. One area when this is particularly important is home inspections.

  7. Thank you for the sensible critique. Me and my neighbor were just preparing to do a little research on this. We got a grab a book from our local library but I think I learned more clear from this post. I am very glad to see such wonderful information being shared freely out there.

  8. I抣l immediately grab your rss feed as I can not find your e-mail subscription link or newsletter service. Do you have any? Please let me know in order that I could subscribe. Thanks.

  9. Hi there! This post could not be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this post to him. Fairly certain he will have a good read. Thanks for sharing!

  10. Good post. I be taught something more challenging on different blogs everyday. It can all the time be stimulating to read content from other writers and follow slightly one thing from their store. I抎 prefer to use some with the content on my blog whether you don抰 mind. Natually I抣l offer you a hyperlink in your internet blog. Thanks for sharing.

  11. Hey there this is kinda of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding expertise so I wanted to get advice from someone with experience. Any help would be enormously appreciated!

  12. F*ckin?remarkable issues here. I am very happy to see your article. Thank you a lot and i’m taking a look forward to contact you. Will you please drop me a e-mail?

  13. Hey just wanted to give you a brief heads up and let you know a few of the images aren’t loading correctly. I’m not sure why but I think its a linking issue. I’ve tried it in two different browsers and both show the same results.

  14. I have noticed that car insurance providers know the motors which are susceptible to accidents along with other risks. They also know what type of cars are given to higher risk and the higher risk they have got the higher your premium amount. Understanding the very simple basics regarding car insurance will let you choose the right style of insurance policy that can take care of your family needs in case you get involved in an accident. Thanks for sharing a ideas in your blog.

  15. I have come to understand that fees for online degree gurus tend to be an excellent value. For example a full Bachelor’s Degree in Communication from The University of Phoenix Online consists of 60 credits from $515/credit or $30,900. Also American Intercontinental University Online offers a Bachelors of Business Administration with a overall program requirement of 180 units and a tuition fee of $30,560. Online studying has made getting the education far more easy because you could earn your own degree in the comfort of your house and when you finish from work. Thanks for other tips I’ve learned through the site.

  16. I have noticed that car insurance providers know the cars and trucks which are liable to accidents along with other risks. Additionally they know what type of cars are given to higher risk as well as the higher risk they’ve got the higher the particular premium price. Understanding the very simple basics of car insurance will let you choose the right sort of insurance policy that should take care of your requirements in case you become involved in any accident. Many thanks sharing the actual ideas on the blog.

  17. One other issue is when you are in a situation where you do not possess a cosigner then you may want to try to make use of all of your federal funding options. You can get many funds and other scholarships that will supply you with funding to support with college expenses. Thank you for the post.

  18. This is really interesting, You are a very skilled blogger. I’ve joined your rss feed and look forward to seeking more of your excellent post. Also, I have shared your site in my social networks!

  19. Some tips i have seen in terms of personal computer memory is the fact that there are specs such as SDRAM, DDR etc, that must go with the features of the mother board. If the pc’s motherboard is very current and there are no computer OS issues, replacing the memory literally will take under an hour or so. It’s among the easiest personal computer upgrade processes one can visualize. Thanks for discussing your ideas.

  20. Thank you for another informative blog. Where else could I get that type of info written in such an ideal way? I have a project that I am just now working on, and I’ve been on the look out for such info.

Leave a Reply

Your email address will not be published. Required fields are marked *