postgreSQLpgfincoreintroduces

postgreSQL pgfincore introduces pgfincore 和shared buffer不同，是OS层面的缓存，可以把大对象缓存到OS的cache里，其实就是内存，所以机器的内存配置越大越好，至于oracle是缓存到buffer_pool_keep，可以手工刷出，不过这个是database的缓存，和pg的share

postgreSQL pgfincore introduces

pgfincore 和shared buffer不同，是OS层面的缓存，可以把大对象缓存到OS的cache里，其实就是内存，所以机器的内存配置越大越好，至于oracle是缓存到buffer_pool_keep，可以手工刷出，不过这个是database的缓存，和pg的shared buffer同理。这里就不再详细介绍。

1.下载wget http://pgfoundry.org/frs/download.php/3186/pgfincore-v1.1.1.tar.gz

2.解压下载的安装包tar -zxvf pgfincore-v1.1.1.tar.gz

3.复制解压后的目录到pg源代码目录/contrib

4.安装：

postgres用户：

make clean

make

su - root

source /home/postgres/.bash_profile

make install

根据READ.rst

For PostgreSQL >= 9.1, log in your database and::

mydb=# CREATE EXTENSION pgfincore;

For other release, create the functions from the sql script (it should be in

your contrib directory)::

psql mydb -f pgfincore.sql

postgres=# select version();

version

---------------------------------------------------

PostgreSQL 9.1.2 on x86_64-unknown-linux-gnu, compiled by gcc (GCC) 4.1.2 20071124 (Red Hat 4.1.2-42), 64-bit

postgres=# CREATE EXTENSION pgfincore;

CREATE EXTENSION

postgres=# select * from pg_extension ;

extname | extowner | extnamespace | extrelocatable | extversion | extconfig | extcondition

----------------+----------+--------------+----------------+------------+-----------+--------------

plpgsql | 10 | 11 | f | 1.0 | |

pg_buffercache | 10 | 2200 | t | 1.0 | |

pgfincore | 10 | 2200 | t | 1.1.1 | |

pgfincore使用：

pgfincore 对象的cache情况

pgfadvise_willneed 将对象刷入cache

pgfadvise_dontneed 将对象刷出cache

pgfadvise_loader 直接和page cache交互，加载，卸载页面

pgsysconf 操作系统的cache情况

pgsysconf_pretty同上，只不过输更易懂，带上了单位。

postgres=# \d t

Table "public.t"

Column | Type | Modifiers

--------+---------+-----------------------------------------------

s | integer | not null default nextval('t_s_seq'::regclass)

i | integer |

postgres=# insert into t(i) values (generate_series(1,10000000));

INSERT 0 10000000

postgres=# select pg_size_pretty(pg_relation_size('t'));

pg_size_pretty

----------------

346 MB

当前文件系统的使用情况：pgsysconf()，pgsysconf_pretty()

postgres=# select * from pgsysconf();

os_page_size | os_pages_free | os_total_pages

--------------+---------------+----------------

4096 | 182787 | 2044328

postgres=# select * from pgsysconf_pretty();

os_page_size | os_pages_free | os_total_pages

--------------+---------------+----------------

4096 bytes | 721 MB | 7986 MB

(1 row)

表t的使用情况：pgfincore

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 181767 |

os_page_size：文件系统页大小

rel_os_pages：占用文件系统页数量

pages_mem：有多少文件系统页在系统cache

刷入cache：pgfadvise_willneed()

postgres=# select * from pgfadvise_willneed('t');

relpath | os_page_size | rel_os_pages | os_pages_free

------------------+--------------+--------------+---------------

base/12699/16441 | 4096 | 88496 | 186428

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 186397 |

(1 row)

刷出cache：

postgres=# select * from pgfadvise_dontneed('t');

relpath | os_page_size | rel_os_pages | os_pages_free

------------------+--------------+--------------+---------------

base/12699/16441 | 4096 | 88496 | 275021

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 0 | 0 | 275052 |

(1 row)

pgfadvise_loader:

postgres=# select * from pgfadvise_loader('t', 0, true, true, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186626 | 3 | 3

(1 row)

loading：

postgres=# select * from pgfadvise_loader('t', 0, true, false, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186460 | 3 | 0

(1 row)

unloading：

postgres=# select * from pgfadvise_loader('t', 0, false, true, B'111000');

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186557 | 0 | 3

(1 row)

pgfadvise_NORMAL

pgfadvise_SEQUENTIAL

pgfadvise_RANDOM

这几个可以指定当前内存的属性，正常，顺序，还是随机。

快照与恢复：

做快照：

create table pgfincore_snapshot as

select 't'::text as relname,*,now() as date_snapshot

from pgfincore('t',true);

应用快照：

select * from pgfadvise_loader('t', 0, true, true,

(select databit from pgfincore_snapshot

where relname='t' and segment = 0));

relpath | os_page_size | os_pages_free | pages_loaded | pages_unloaded

------------------+--------------+---------------+--------------+----------------

base/12699/16441 | 4096 | 186259 | 88490 | 6

(1 row)

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88490 | 2 | 186097 |

(1 row)

可以看到 88496 和88490，有几个页面是刷出cache，所以不相等

select * from pgfadvise_willneed('t');

postgres=# select * from pgfincore('t');

relpath | segment | os_page_size | rel_os_pages | pages_mem | group_mem | os_pages_free | databit

------------------+---------+--------------+--------------+-----------+-----------+---------------+---------

base/12699/16441 | 0 | 4096 | 88496 | 88496 | 1 | 186227 |

(1 row)

限制：

*PgFincore needs mincore() and POSIX_FADVISE.

*PgFincore has a limited mode when POSIX_FADVISE is not provided by the platform.

*PgFincore needs PostgreSQL >= 8.3