hive 一坑记录

Caused by: java.util.regex.PatternSyntaxException: Unclosed character class near

https://stackoverflow.com/questions/21816788/unclosed-character-class-error

virtual box 内网银使用

http://www.sijitao.net/618.html
https://www.virtualbox.org/wiki/Download_Old_Builds virtual box 历史的pack可以从这里下载

intellij idea 快捷键

1.搜索文件搜不到，如eva.js能看见，但是找不到
参考https://stackoverflow.com/questions/13685036/how-can-i-find-particular-file-in-intellij-idea

blog清除格式

1.html
2.右上角text x号
参考http://www.cookistry.com/2013/01/blogger-tip-get-rid-of-weird-formatting.html

xgboost 保存为pmml文件问题

xgboost 二进制文件，可以通过https://github.com/jpmml/jpmml-xgboost 保存为pmml文件，

但是feature map怎么生成呢

官方关于这点的说明，只有陈天奇的回复

https://github.com/dmlc/xgboost/issues/256

重点在这句

刚才那个开源转换工具在接受feature map的时候，是需要这样的文件的

0 cyl int

1 disp q

2 hp q

3 drat q

4 wt q

5 qsec q

6 vs=0 i

7 vs=1 i

8 am=0 i

9 am=1 i

10 gear int

11 carb int

有几点需要说明

1.分隔符必须是\t分割

2.int 代表int

3.q代表float

4.i代买 binary之后的int，

测试方法，可以通过以下代码获知

system('defaults write org.R-project.R force.LANG en_US.UTF-8')

install.packages("devtools")

library("devtools")

install_git("git://github.com/jpmml/r2pmml.git")

library("r2pmml")

library("xgboost")

data(mtcars)

# Convert selected columns from numeric datatype to integer or factor datatypes

mtcars$cyl = as.integer(mtcars$cyl)

mtcars$vs = as.factor(mtcars$vs)

mtcars$am = as.factor(mtcars$am)

mtcars$gear = as.integer(mtcars$gear)

mtcars$carb = as.integer(mtcars$carb)

mpg_y = mtcars[, 1]

mpg_X = mtcars[, 2:ncol(mtcars)]

# Generate feature map

mpg.fmap = r2pmml::genFMap(mpg_X)

r2pmml::writeFMap(mpg.fmap, "xgboost.fmap")

# Generate DMatrix

mpg.dmatrix = r2pmml::genDMatrix(mpg_y, mpg_X, "xgboost.svm")

set.seed(31)

# Train a linear regression model

mpg.xgb = xgboost(data = mpg.dmatrix, objective = "reg:linear", nrounds = 7)

# Save the model in XGBoost proprietary binary format

xgb.save(mpg.xgb, "xgboost.model")

# Dump the model in text format

xgb.dump(mpg.xgb, "xgboost.model.txt", fmap = "xgboost.fmap")

在mac下使用ggplot2画图的中文显示问题

library(readr)
segsimcat <- read_delim("~/segsimcat.txt",
                        "\t", escape_double = FALSE, trim_ws = TRUE)
View(segsimcat)


colnames(segsimcat)
library(ggplot2)
library(dplyr)
unique(segsimcat$name)
ggplot(filter(segsimcat,name=="美食"), aes(sim)) +
  geom_histogram(bins = 100)

ggplot(segsimcat, aes(sim, colour = name)) +
  geom_freqpoly(bins = 100)+theme(text = element_text(family = "STHeiti"))
# binwidth = 500
ggplot(segsimcat, aes(sim, fill = name)) +
  geom_histogram(bins = 100)+theme(text = element_text(family = "STHeiti"))


for(x in unique(segsimcat$name)){
print(ggplot(filter(segsimcat,name==x), aes(sim)) +
  geom_histogram(bins = 100)+ggtitle(x)+theme(text = element_text(family = "STHeiti"))
  )}

重点参考：for-loop https://www.r-bloggers.com/how-to-write-the-first-for-loop-in-r/

http://www.reed.edu/data-at-reed/resources/R/loops_with_ggplot2.html

添加标题 https://stackoverflow.com/questions/40675778/center-plot-title-in-ggplot2

ggplot2在for循环中的问题 https://stackoverflow.com/questions/15678261/r-ggplot-does-not-work-if-it-is-inside-a-for-loop-although-it-works-outside-of

中文显示问题 http://not.farbox.com/post/chinese-character-font-mac-rlan


rmarkdown 到pdf的中文问题：
https://github.com/yixuan/showtext
https://statr.me/2014/01/using-system-fonts-in-r-graphs/

word2vec 编译异常信息

gcc word2vec.c -o word2vec -lm -pthread -O3 -march=native -Wall -funroll-loops -Wno-unused-result
gcc word2phrase.c -o word2phrase -lm -pthread -O3 -march=native -Wall -funroll-loops -Wno-unused-result
gcc distance.c -o distance -lm -pthread -O3 -march=native -Wall -funroll-loops -Wno-unused-result
distance.c: In function ‘main’:
distance.c:31:8: warning: unused variable ‘ch’ [-Wunused-variable]
   char ch;
        ^
gcc word-analogy.c -o word-analogy -lm -pthread -O3 -march=native -Wall -funroll-loops -Wno-unused-result
word-analogy.c: In function ‘main’:
word-analogy.c:31:8: warning: unused variable ‘ch’ [-Wunused-variable]
   char ch;
        ^
gcc compute-accuracy.c -o compute-accuracy -lm -pthread -O3 -march=native -Wall -funroll-loops -Wno-unused-result
compute-accuracy.c: In function ‘main’:
compute-accuracy.c:29:109: warning: unused variable ‘ch’ [-Wunused-variable]
   char st1[max_size], st2[max_size], st3[max_size], st4[max_size], bestw[N][max_size], file_name[max_size], ch;
                                                                                                             ^
chmod +x *.sh