Archives for March 2015

Hive ODBC Connection ETIMEDOUT

By @sskaje
Link: https://sskaje.me/2015/03/hive-odbc-etimedout/

I was trying to connect TableAU to Cloudera Hadoop on Windows, every time I got an error saying ETIMEDOUT, no other error message can be found.

To solve this, make sure HiveServer 2 can be selected, and for Authentication Mechanism, choose Username and then type ‘hive‘ in the Username text.

Hive ODBC Connection ETIMEDOUT by @sskaje: https://sskaje.me/2015/03/hive-odbc-etimedout/

Incoming search terms:

HE.net Dynamic DNS on Ubiquiti Router

By @sskaje
Link: https://sskaje.me/2015/03/he-net-ddns-on-ubnt-router/

HE.net provides free DDNS service, compatible with DynDNS’s update format.
Link: Dynamic DNS on HE.net.

I’m using Ubiquiti EdgeRouter Lite, Dynamic DNS support can be found from web GUI console, but the server address is not configurable.

Here is a copy of my config:

     dns {
         dynamic {
             interface pppoe0 {
                 service dyndns {
                     host-name ddns.record.my.domain
                     login ddns.record.my.domain
                     password [PASSWORD]
                     server dyn.dns.he.net
                 }
             }
         }
    }

dns {

dynamic {

interface pppoe0 {

service dyndns {

host-name ddns.record.my.domain

password [PASSWORD]

server dyn.dns.he.net

}

You can also configure from CLI.

ubnt@ubnt:~$ configure 
[edit]
ubnt@ubnt# edit  service dns dynamic  interface pppoe0 
[edit service dns dynamic interface pppoe0]
ubnt@ubnt# set service dyndns 
ubnt@ubnt# set service dyndns host-name ddns.record.my.domain
ubnt@ubnt# set service dyndns login ddns.record.my.domain
ubnt@ubnt# set service dyndns password PASSWORD
ubnt@ubnt# set service dyndns server dyn.dns.he.net
ubnt@ubnt# commit
ubnt@ubnt# save

ubnt@ubnt:~$ configure

[edit]

ubnt@ubnt# edit service dns dynamic interface pppoe0

[edit service dns dynamic interface pppoe0]

ubnt@ubnt# set service dyndns

ubnt@ubnt# set service dyndns host-name ddns.record.my.domain

ubnt@ubnt# set service dyndns login ddns.record.my.domain

ubnt@ubnt# set service dyndns password PASSWORD

ubnt@ubnt# set service dyndns server dyn.dns.he.net

ubnt@ubnt# commit

ubnt@ubnt# save

1 Pick the right interface
2 Set server
3 DO NOT SAVE OR UPDATE FROM WEB GUI CONSOLE!

HE.net Dynamic DNS on Ubiquiti Router by @sskaje: https://sskaje.me/2015/03/he-net-ddns-on-ubnt-router/

Incoming search terms:

Nginx 反向代理过滤Cookie

By @sskaje
Link: https://sskaje.me/2015/03/nginx-proxy-filter-cookie/

一个项目需求需要过滤HTTP头中的特定cookie项目。
代理使用nginx搭建，编译参数如下：

./configure --with-cc-opt='-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -D_FORTIFY_SOURCE=2' 
--with-ld-opt='-Wl,-Bsymbolic-functions -Wl,-z,relro' 
--prefix=/usr/share/nginx 
--conf-path=/etc/nginx/nginx.conf --sbin-path=/usr/sbin/nginx --http-log-path=/var/log/nginx/access.log --error-log-path=/var/log/nginx/error.log 
--lock-path=/var/lock/nginx.lock --pid-path=/run/nginx.pid --http-client-body-temp-path=/var/lib/nginx/body 
--http-fastcgi-temp-path=/var/lib/nginx/fastcgi --http-proxy-temp-path=/var/lib/nginx/proxy --http-scgi-temp-path=/var/lib/nginx/scgi 
--http-uwsgi-temp-path=/var/lib/nginx/uwsgi --with-debug 
--with-pcre-jit --with-ipv6 --with-http_ssl_module --with-http_stub_status_module 
--with-http_realip_module --with-http_addition_module --with-http_dav_module --with-http_geoip_module 
--with-http_gzip_static_module --with-http_image_filter_module --with-http_spdy_module --with-http_sub_module 
--with-http_xslt_module --add-module=/root/ngx_http_substitutions_filter_module/ 
--add-module=/root/build/lua-nginx-module/ --add-module=/root/build/ngx_devel_kit

./configure --with-cc-opt='-g -O2 -fstack-protector-strong -Wformat -Werror=format-security -D_FORTIFY_SOURCE=2'

--with-ld-opt='-Wl,-Bsymbolic-functions -Wl,-z,relro'

--prefix=/usr/share/nginx

--conf-path=/etc/nginx/nginx.conf --sbin-path=/usr/sbin/nginx --http-log-path=/var/log/nginx/access.log --error-log-path=/var/log/nginx/error.log

--lock-path=/var/lock/nginx.lock --pid-path=/run/nginx.pid --http-client-body-temp-path=/var/lib/nginx/body

--http-fastcgi-temp-path=/var/lib/nginx/fastcgi --http-proxy-temp-path=/var/lib/nginx/proxy --http-scgi-temp-path=/var/lib/nginx/scgi

--http-uwsgi-temp-path=/var/lib/nginx/uwsgi --with-debug

--with-pcre-jit --with-ipv6 --with-http_ssl_module --with-http_stub_status_module

--with-http_realip_module --with-http_addition_module --with-http_dav_module --with-http_geoip_module

--with-http_gzip_static_module --with-http_image_filter_module --with-http_spdy_module --with-http_sub_module

--with-http_xslt_module --add-module=/root/ngx_http_substitutions_filter_module/

--add-module=/root/build/lua-nginx-module/ --add-module=/root/build/ngx_devel_kit

其中用到了两个插件：

https://github.com/simpl/ngx_devel_kit
https://github.com/openresty/lua-nginx-module

参考示例：

    location ~ ^/test/ {
        proxy_pass http://127.0.0.1:9988;
        include /etc/nginx/conf.d/filter_cookie.inc;
    }

location ~ ^/test/ {

proxy_pass http://127.0.0.1:9988;

include /etc/nginx/conf.d/filter_cookie.inc;

}

参考过滤脚本：

# more /etc/nginx/conf.d/filter_cookie.inc 
set_by_lua $filter_cookie '

function filterCookie(cookie)
        HEADER = "SSSS"
        local ret = ""
        local i, j = string.find(cookie, HEADER .. "=")
        if (i == nil) then
                return cookie
        end

        if (i > 1) then
                ret = ret .. string.sub(cookie, 0, i-1)
        end
        local m, n = string.find(cookie, ";", j)
        if (n ~= nil) then
                ret = ret .. string.sub(cookie, n+1)
        end
        return ret
end

return filterCookie(ngx.var.http_cookie)';

# more /etc/nginx/conf.d/filter_cookie.inc

set_by_lua $filter_cookie '

function filterCookie(cookie)

HEADER = "SSSS"

local ret = ""

local i, j = string.find(cookie, HEADER .. "=")

if (i == nil) then

return cookie

end

if (i > 1) then

ret = ret .. string.sub(cookie, 0, i-1)

end

local m, n = string.find(cookie, ";", j)

if (n ~= nil) then

ret = ret .. string.sub(cookie, n+1)

end

return ret

end

return filterCookie(ngx.var.http_cookie)';

测试用例

print(filterCookie(""))
print(filterCookie("aaa=1"))
print(filterCookie("aaa=1; SSSS"))
print(filterCookie("aaa=1; SSSS="))
print(filterCookie("aaa=1; SSSS=1"))
print(filterCookie("aaa=1; SSSS=1;"))
print(filterCookie("aaa=1; SSSS=1; "))
print(filterCookie("aaa=1; SSSS=1; a"))
print(filterCookie("aaa=1; SSSS=1; a=2"))
print(filterCookie("aaa=1; SSSS=1; a=2;"))
print(filterCookie("SSSS"))
print(filterCookie("SSSS="))
print(filterCookie("SSSS=1"))
print(filterCookie("SSSS=1;"))
print(filterCookie("SSSS=1; "))
print(filterCookie("SSSS=1; a"))
print(filterCookie("SSSS=1; a=2"))
print(filterCookie("SSSS=1; a=2;"))

print(filterCookie(""))

print(filterCookie("aaa=1"))

print(filterCookie("aaa=1; SSSS"))

print(filterCookie("aaa=1; SSSS="))

print(filterCookie("aaa=1; SSSS=1"))

print(filterCookie("aaa=1; SSSS=1;"))

print(filterCookie("aaa=1; SSSS=1; "))

print(filterCookie("aaa=1; SSSS=1; a"))

print(filterCookie("aaa=1; SSSS=1; a=2"))

print(filterCookie("aaa=1; SSSS=1; a=2;"))

print(filterCookie("SSSS"))

print(filterCookie("SSSS="))

print(filterCookie("SSSS=1"))

print(filterCookie("SSSS=1;"))

print(filterCookie("SSSS=1; "))

print(filterCookie("SSSS=1; a"))

print(filterCookie("SSSS=1; a=2"))

print(filterCookie("SSSS=1; a=2;"))

Nginx 反向代理过滤Cookie by @sskaje: https://sskaje.me/2015/03/nginx-proxy-filter-cookie/

Incoming search terms:

nginx lua filter