phoenix异常MutationState size is bigger than maximum allowed number of bytes

phoenix | 2019-09-22 12:12:19

使用phoenix upsert 插入大量数据时出现异常:

java.sql.SQLException: ERROR 730 (LIM02): MutationState size is bigger than maximum allowed number of bytes

具体报错:

解决方法:

主要修改三个参数配置:

phoenix.mutate.batchSize:执行过程中被批处理并自动提交的行数,调大此参数

phoenix.mutate.maxSize :客户端批处理的最大行数,调大此参数

phoenix.mutate.maxSizeBytes :客户端批处理的最大数据量(单位:B),这个参数官网参数列表并未提到,但是确实会有很大影响,同样要调大此参数

修改phoenix的bin目录下的hbase-site.xml,添加如下配置:

        <property>
                <name>phoenix.mutate.batchSize</name>
                <value>5000000</value>
        </property>
        <property>
                <name>phoenix.mutate.maxSize</name>
                <value>50000000</value>
        </property>
        <property>
                <name>phoenix.mutate.maxSizeBytes</name>
                <value>1000000</value>
        </property>

 

phoenix官方配置列表:https://phoenix.apache.org/tuning.html

 

登录后即可回复 登录 | 注册
    
相关文章
mysql解决错误the total number of locks exceeds the lock table sizephoenix异常mutationstate size is bigger than maximum allowed number of bytesphp eventbuffer moves the specified number of bytes from a source buffer to the end of the current bufferphp eventbuffer copies out specified number of bytes from the front of the bufferphp eventbuffer removes specified number of bytes from the front of the buffer without copying it anywherephp ibm db2 函数 returns the maximum number of bytes required to display a columnphp eio 函数 set maximum number of requests processed in a pollphp zlib 函数 get number of bytes read so farphp inotify 函数 return a number upper than zero if there are pending eventsphp socket 函数 reads a maximum of length bytes from a socketphp ktaglib id3v2 frame returns the size of the frame in bytesphp oci collection returns the maximum number of elements in the collectionphp solrquery returns the maximum number of tokens to parse in each document field that is not stored with termvector supportphp solrquery returns the maximum number of documentsphp solrquery returns the maximum number of terms solr should returnphp solrquery sets the maximum number of characters of the field to returnphp solrquery specify the maximum number of characters to analyzephp solrquery sets the maximum number of highlighted snippets to generate per fieldphp solrquery sets the maximum number of query terms includedphp solrquery specifies the maximum number of tokens to parse
关注编程学问公众号