phoenix异常MutationState size is bigger than maximum allowed number of bytes

phoenix | 2019-09-22 12:12:19

使用phoenix upsert 插入大量数据时出现异常:

java.sql.SQLException: ERROR 730 (LIM02): MutationState size is bigger than maximum allowed number of bytes

具体报错:

解决方法:

主要修改三个参数配置:

phoenix.mutate.batchSize:执行过程中被批处理并自动提交的行数,调大此参数

phoenix.mutate.maxSize :客户端批处理的最大行数,调大此参数

phoenix.mutate.maxSizeBytes :客户端批处理的最大数据量(单位:B),这个参数官网参数列表并未提到,但是确实会有很大影响,同样要调大此参数

修改phoenix的bin目录下的hbase-site.xml,添加如下配置:

        <property>
                <name>phoenix.mutate.batchSize</name>
                <value>5000000</value>
        </property>
        <property>
                <name>phoenix.mutate.maxSize</name>
                <value>50000000</value>
        </property>
        <property>
                <name>phoenix.mutate.maxSizeBytes</name>
                <value>1000000</value>
        </property>

 

phoenix官方配置列表:https://phoenix.apache.org/tuning.html

 

登录后即可回复 登录 | 注册
    
相关文章
phoenix异常mutationstate size is bigger than maximum allowed number of bytesjava jdbc连接phoenix hbase异常clientpath null serverpath null finished falsephp eventbuffer moves the specified number of bytes from a source buffer to the end of the current bufferphp eventbuffer copies out specified number of bytes from the front of the bufferphp eventbuffer removes specified number of bytes from the front of the buffer without copying it anywherephp eventhttp sets maximum http header sizephp eventhttpconnection sets maximum body size for the connectionphp eventhttpconnection sets maximum header sizephp ibm db2 函数 returns the maximum number of bytes required to display a columnphp eio 函数 set maximum number of idle threadsphp eio 函数 set maximum number of requests processed in a pollphp solrquery returns the maximum number of characters of the field to returnphp solrquery returns the maximum number of characters into a document to look for suitable snippetsphp solrquery returns the maximum number of characters from a field when using the regex fragmenterphp solrquery returns the maximum number of highlighted snippets to generate per fieldphp solrquery returns the maximum number of query terms that will be included in any generated queryphp solrquery returns the maximum number of tokens to parse in each document field that is not stored with termvector supportphp solrquery specifies the maximum number of rows to return in the resultphp solrquery sets the maximum number of terms to returnspringboot访问mongo异常Transaction numbers are only allowed on a replica set member or mongos
关注编程学问公众号