Linux kernel, wifi hack & security

招商证券股票day数据格式分析

BianJiang — Sun, 08 Jan 2012 23:33:15 +0800

今天没事想把招商证券保存的股票数据提取出来, 后来发现招商证券的软件是采用是通达信做的, 这样直接通过查找通达信的数据格式就搞定了.

主要参考: http://alantop.5166.info/gpdatasoft/gpformat/gpformat.htm#_Toc224993378

通达信日线

每条数据文件占32个字节。每四个字节代表一个变量。如下所示：

struct stockDay
{
uint32_t date; //日期
uint32_t open; //开盘价，单位：分
uint32_t high; //最高价，单位：分
uint32_t low; //最低价，单位：分
uint32_t close; //收盘价，单位：分
float amount; //交易金额，单位：元
uint32_t vol; //成交量，单位：股
int32_t reserv; //保留，有时用来保存上一交易日收盘价
};

我分别使用C和Go写了个简单的提取程序.

C代码:

#include <stdio.h>
#include <stdlib.h>
#include <stdint.h>
#include <string.h>
struct stockDay
{
uint32_t date; //日期
uint32_t open; //开盘价，单位：分
uint32_t high; //最高价，单位：分
uint32_t low; //最低价，单位：分
uint32_t close; //收盘价，单位：分
float amount; //交易金额，单位：元
uint32_t vol; //成交量，单位：股
int32_t reserv; //保留，有时用来保存上一交易日收盘价
};

void printDay(struct stockDay *day)
{
printf(“日期: %d, “, day->date);
printf(“开盘价: %.2f, 最高价: %.2f, 最低价: %.2f, 收盘价: %.2f, “, day->open/100.0, day->high/100.0, day->low/100.0, day->close/100.0);
printf(“交易金额: %f, 交易量: %d\n”, day->amount, day->vol);
}

int main()
{
FILE *p;
int i = 0;
char *file = “./sh600529.day”;
struct stockDay *day = malloc(sizeof(struct stockDay));

p = fopen(file, “r”);
if (p) {
fseek(p, 0, SEEK_END);
uint64_t iFileLen = ftell(p)/(sizeof(struct stockDay));
rewind(p);
for (i = 0; i < iFileLen; i++) {
memset(day, 0, sizeof(struct stockDay));
fread(day, sizeof(struct stockDay), 1, p);
printDay(day);
}

} else {
printf(“Read File: %s Error!\n”, file);
}

free(day);
fclose(p);
return 0;
}

Go的代码:

package main

import (
“bytes”
“encoding/binary”
“fmt”
“io/ioutil”
“unsafe”
)

type StockDay struct {
date uint32 //日期
open uint32 //开盘价，单位：分
high uint32 //最高价，单位：分
low uint32 //最低价，单位：分
cls uint32 //收盘价，单位：分
amount float32 //交易金额，单位：元
vol uint32 //成交量，单位：股
reserv int32 //保留，有时用来保存上一交易日收盘价
}

func main() {
contents, _ := ioutil.ReadFile(“./sh887001.day”)
//println(string(contents));
var day StockDay
size := int(unsafe.Sizeof(day))
fmt.Printf(“sizeof: %d, days: %d\n”, size, len(contents)/size)
for i := 0; i < len(contents); i += 32 {
buf := bytes.NewBuffer(contents[i : i+4])
err := binary.Read(buf, binary.LittleEndian, &day.date)
if err != nil {
fmt.Println(“binary.Read failed: “, err)
}
buf = bytes.NewBuffer(contents[i+4 : i+8])
err = binary.Read(buf, binary.LittleEndian, &day.open)

buf = bytes.NewBuffer(contents[i+8 : i+12])
err = binary.Read(buf, binary.LittleEndian, &day.high)

buf = bytes.NewBuffer(contents[i+12 : i+16])
err = binary.Read(buf, binary.LittleEndian, &day.low)

buf = bytes.NewBuffer(contents[i+16 : i+20])
err = binary.Read(buf, binary.LittleEndian, &day.cls)

buf = bytes.NewBuffer(contents[i+20 : i+24])
err = binary.Read(buf, binary.LittleEndian, &day.amount)

buf = bytes.NewBuffer(contents[i+24 : i+28])
err = binary.Read(buf, binary.LittleEndian, &day.vol)

fmt.Printf(“%v\n”, day)
}
}

代码也贴在Github上: https://gist.github.com/1578661

ps: 目前5分钟线的月份和日期对不上, 不知道哪位高手搞过?

–EOF–

golang Byte数组转换为浮点数

BianJiang — Sun, 08 Jan 2012 10:53:00 +0800

今天没事想用go从文件中提取些二进制数据，并把数据转换为相关的数据类型，就找到一个把数组转换为float类型的数据。主要用到了encoding/binary包里面的read函数，它可以根据你数据的大小端得到相关的数据类型。

主要代码如下:

package main

import (
“bytes”
“encoding/binary”
“fmt”
)

func main() {
var pi float64
b := []byte{0×18, 0x2d, 0×44, 0×54, 0xfb, 0×21, 0×09, 0×40}
buf := bytes.NewBuffer(b)
err := binary.Read(buf, binary.LittleEndian, &pi)
if err != nil {
fmt.Println(“binary.Read failed:”, err)
}
fmt.Println(pi)
}

下面是go里面uint32在大小端的分别实现:

bvcom@bvcomtv:~$ godoc -src encoding/binary Uint32
// A ByteOrder specifies how to convert byte sequences into
// 16-, 32-, or 64-bit unsigned integers.
type ByteOrder interface {
Uint32([]byte) uint32
// contains filtered or unexported methods
}

func (littleEndian) Uint32(b []byte) uint32 {
return uint32(b[0]) | uint32(b[1])<<8 | uint32(b[2])<<16 | uint32(b[3])<<24
}

func (bigEndian) Uint32(b []byte) uint32 {
return uint32(b[3]) | uint32(b[2])<<8 | uint32(b[1])<<16 | uint32(b[0])<<24
}

参考:
Convert 8 byte array to int64? Options: http://groups.google.com/group/golang-nuts/browse_thread/thread/7f541090fd7d1bd4

Reading byte array as another datatype Options: http://groups.google.com/group/golang-nuts/browse_thread/thread/fc00115bf5b35757

http://golang.org/src/pkg/encoding/binary/binary.go?s=3435:3501#L117

–EOF–

Go 1 will be

BianJiang — Sun, 01 Jan 2012 10:37:17 +0800

在golang-nuts邮件列表里面, 有人问了有关Go 1的情况, golang的主要开发者Brad Fitzpatrick说: Go 1 相关的库和包, 都已经完成, 节后只修复相关的Bug, 修复完后就会发布Go 1.
如果你想使用可以使用最新Weekly版本2011-12-22, 这个基本上就是Go1 版本.

原文如下:
All the major Go 1 language & library changes are now in. Bug fixing &
polish begins after the holidays, then some release candidates will start
going out. The latest weekly, 2011-12-22 is basically what Go 1 will be,
if you want to start playing.

参考: http://groups.google.com/group/golang-n … 3abf4b868b

Reaver在10小时之内破解WPA密码

BianJiang — Thu, 29 Dec 2011 13:07:04 +0800

从Hacker News看到一个WPA破解的工具Reaver, 号称能在10小时之内破解WPA, 晚上回去试试看.

The WiFi Protected Setup protocol is vulnerable to a brute force attack that allows an attacker to recover an access point’s WPS pin, and subsequently the WPA/WPA2 passphrase, in just a matter of hours.

This is something that I’ve been testing and using for a while now, but Stefan over at.braindump beat me to publication. Such is life.

Stefan’s code isn’t quite ready for release yet, so I’ve open-sourced Reaver, my WPS attack tool. Reaver is stable and has been tested against a variety of access points and WPS implementations.

Usage is simple; just specify the target BSSID and the monitor mode interface to use:

# reaver -i mon0 -b 00:01:02:03:04:05

For those interested, there is also a commercial version available with more features and speed improvements.

原文参考: http://www.devttys0.com/2011/12/cracking-wpa-in-10-hours-or-less/

–EOF–

buildroot编译出错信息

BianJiang — Tue, 20 Dec 2011 19:03:46 +0800

1. PATH环境变量有当前目录
错误信息:

border@b0rder:/work/tss/src/lichee/buildroot$ ./build.sh -p sun4i -m buildroot

You seem to have the current working directory in your PATH environment variable. This doesn’t work.

make: *** [dependencies] 错误 1

解决方法,

border@b0rder:/work/tss/src/lichee/buildroot$ echo $PATH .:/home/border/bin/jdk1.6.0_26/bin:.:.:/home/border/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/arm/arm-2010.09/bin:/home/border/go/bin://home/border/bin:/usr/local/arm/arm-2009q3/bin:/home/border/bin:/work/vc1000/src/android-vc1000/out/host/linux-x86/bin:/home/border/bin:/home/border/work/depot_tools:/home/border/work/app/google_appengine:/work/vc1000/src/android-vc1000/prebuilt/linux-x86/toolchain/arm-eabi-4.4.0/bin:/home/border/work/android/eclipse-x64:/home/border/work/ai/python/:/home/border/work/ai/python/tools

上面的.表示当前目录信息，去掉. 后才能正常编译。

border@b0rder:/work/tss/src/lichee/buildroot$ export PATH=/home/border/bin/jdk1.6.0_26/bin:/home/border/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/arm/arm-2010.09/bin:/home/border/go/bin://home/border/bin:/usr/local/arm/arm-2009q3/bin:/home/border/bin:/work/vc1000/src/android-vc1000/out/host/linux-x86/bin:/home/border/bin:/home/border/work/depot_tools:/home/border/work/app/google_appengine:/work/vc1000/src/android-vc1000/prebuilt/linux-x86/toolchain/arm-eabi-4.4.0/bin:/home/border/work/android/eclipse-x64:/home/border/work/ai/python/:/home/border/work/ai/python/tools border@b0rder:/work/tss/src/lichee/buildroot$ echo $PATH /home/border/bin/jdk1.6.0_26/bin:/home/border/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/arm/arm-2010.09/bin:/home/border/go/bin://home/border/bin:/usr/local/arm/arm-2009q3/bin:/home/border/bin:/work/vc1000/src/android-vc1000/out/host/linux-x86/bin:/home/border/bin:/home/border/work/depot_tools:/home/border/work/app/google_appengine:/work/vc1000/src/android-vc1000/prebuilt/linux-x86/toolchain/arm-eabi-4.4.0/bin:/home/border/work/android/eclipse-x64:/home/border/work/ai/python/:/home/border/work/ai/python/tools

2. makeinfo
错误信息:

border@b0rder:/mnt/ubuntu32/work/tss/src/lichee$ ./build.sh -p sun4i -m buildroot

You must install ‘makeinfo’ on your build machine makeinfo is usually part of the texinfo package in your distribution

make: *** [dependencies] 错误 1

解决方法:

sudo apt-get install texinfo

–EOF–

Android 4.0 (Ice Cream Sandwich) 源码发布了

BianJiang — Tue, 15 Nov 2011 09:47:15 +0800

From: http://groups.google.com/group/android-building/browse_thread/thread/4f85d9242667a85f?pli=1

Hi! We just released a bit of code we thought this group might be interested in.
Over at our Android Open-Source Project git servers, the source code
for Android version 4.0 (Ice Cream Sandwich) is now available.
Here’s how to get it:Follow the instructions at
http://source.android.com/source/downloading.html Check out the
‘ics-release’ branch:repo init -u
https://android.googlesource.com/platform/manifest -b android-4.0.1_r1
That’s it! However since this is a large push, please be aware that it
will take some time to complete. If you sync before it’s done, you’ll
get an incomplete copy that you won’t be able to use, so please wait
for us to give the all-clear before you sync.
This is actually the source code for version 4.0.1 of Android, which
is the specific version that will ship on the Galaxy Nexus, the first
Android 4.0 device. In the source tree, you will find a device build
target named “full_maguro” that you can use to build a system image
for Galaxy Nexus. Build configurations for other devices will come
later.
Unfortunately we still don’t have our Gerrit code review servers back
online. That remains our top priority though, and we hope to have them
back soon.
This release includes the full history of the Android source code
tree, which naturally includes all the source code for the Honeycomb
releases. However, since Honeycomb was a little incomplete, we want
everyone to focus on Ice Cream Sandwich. So, we haven’t created any
tags that correspond to the Honeycomb releases (even though the
changes are present in the history.)

JBQ, on behalf of the AOSP team.
–
Jean-Baptiste M. “JBQ” Queru
Software Engineer, Android Open-Source Project, Google.

Questions sent directly to me that have no reason for being private
will likely get ignored or forwarded to a public forum with no further
warning.

Kernel debug with kgtp on android

BianJiang — Tue, 01 Nov 2011 23:31:04 +0800

KGTP is a realtime and lightweight Linux Kernel GDB debugger and tracer. It makes Linux Kernel supply a GDB remote debug interface. Then GDB in current machine or remote machine can debug and trace Linux through GDB tracepoint without stopping the Linux Kernel. And even if the board doesn’t have GDB on it and doesn’t have interface for remote debug. It can debug the Linux Kernel using offline debug. Now, it supports X86-32, X86-64, MIPS and ARM.

This article describes how to use kgtp debug linux kernel on android.

Kernel Building

 General setup  --->
     [ * ] Prompt for development and/or incomplete code/drivers
     [ * ] Kprobe
Kernel hacking  --->
     [ * ] Compile the kernel with debug info
     [ * ] Compile the kernel with frame pointers

Building KGTP

Config KGTP Makefile

KERNELDIR := /work/vc1000/src/kernel-vc1000-2.3
ARCH=arm
CROSS_COMPILE=/usr/local/arm/arm-2009q3/bin/arm-none-linux-gnueabi-

error: ‘GTP_VAR_RDTSC_ID’ undeclared(latest version fixed By: teawater )

  CC [M]  /home/border/work/kernel/kgtp/trunk/gtp.o
/home/border/work/kernel/kgtp/trunk/gtp.c: In function 'gtp_gdbrsp_qtv':
/home/border/work/kernel/kgtp/trunk/gtp.c:6318: error: 'GTP_VAR_RDTSC_ID' undeclared (first use in this function)
/home/border/work/kernel/kgtp/trunk/gtp.c:6318: error: (Each undeclared identifier is reported only once
/home/border/work/kernel/kgtp/trunk/gtp.c:6318: error: for each function it appears in.)
/home/border/work/kernel/kgtp/trunk/gtp.c:6320: error: implicit declaration of function 'rdtscll'

* solution:

diff --git a/trunk/gtp.c b/trunk/gtp.c
index 4d0c9a2..75c145e 100644
--- a/trunk/gtp.c
+++ b/trunk/gtp.c
@@ -6315,11 +6315,13 @@ gtp_gdbrsp_qtv(char *pkg)
                if (num == GTP_VAR_CLOCK_ID) {
                        val = (uint64_t)GTP_LOCAL_CLOCK;
                        goto output_value;
+#ifdef CONFIG_X86
                } else if (num == GTP_VAR_RDTSC_ID) {
                        unsigned long long a;
                        rdtscll(a);
                        val = (uint64_t)a;
                        goto output_value;
+#endif
                } else if (num == GTP_VAR_XTIME_SEC_ID
                           || num == GTP_VAR_XTIME_NSEC_ID) {
                        struct timespec time

Complie and Install KGTP

make
sudo su
adb push gtp.ko /system/vendor/lib
exit

KGTP Running On Android

#Open the KGTP interface in current machine.
su
cd /system/vendor/lib
insmod gtp.ko
lsmod
nc -l -p 1234 < /sys/kernel/debug/gtp > /sys/kernel/debug/gtp

Host PC

cd /work/vc1000/src/kernel-vc1000-2.3
make -j8

Network connect to gtp

# symbian use "set gnutarget elf32-littlearm-symbian"
# vxworks use "set gnutarget elf32-littlearm-vxworks"
gdb-release -ex "set gnutarget elf32-littlearm" -ex "file ./vmlinux"

# if you want see the debug info
(gdb) set debug remote 1

# connection your remote device
(gdb) target remote 192.168.2.213:1234

USB connect to gtp

sudo su
# forward socket(adb forward <local> <remote>)
adb forward tcp:1234 tcp:1234
exit
gdb-release -ex "set gnutarget elf32-littlearm" -ex "file ./vmlinux"
# connection your remote device
(gdb) target remote 127.0.0.1:1234

Debugging with gtp

(gdb) trace vfs_readdir
Tracepoint 1 at 0xc02289f0: file /build/buildd/linux-2.6.35/fs/readdir.c, line 23.
(gdb) actions
Enter actions for tracepoint 1, one per line.
End with a line saying just "end".
>collect $reg
>end
(gdb) tstart

Change To Android Device Shell And Run ls Command * Android Device

$ ls

Back To Host PC GDB Shell * Host PC

(gdb) shell ls
vmlinux-2.6.35-30-generic
(gdb) tstop
(gdb) tfind
Found trace frame 0, tracepoint 1
#0  vfs_readdir (file=0x0, filler=0x163d8ae3, buf=0x18c0) at /build/buildd/linux-2.6.35/fs/readdir.c:23
23      {

Good luck, Happy Hacking…

Very grateful for teawater

References

* kgtp Linux Kernel GDB Tracepoint module

* kgtp Quick start

* kgtp How to

* How To Use KGTP In Android

* GDB Tracepoints

AOSP source code back online

BianJiang — Fri, 21 Oct 2011 09:26:36 +0800

Hi!

As you know, like many other projects the Android Open-Source Project was affected by the recent kernel.org downtime. So, we’re pleased to let you know that the Gingerbread source code is now available again, and AOSP git servers are back online.

Even before the kernel.org downtime, it was clear that AOSP was sometimes taxing kernel.org’s git infrastructure. When we did the Gingerbread source release, for example, load due to AOSP made part of kernel.org unusable for several days. This isn’t fair to kernel.org’s staff or the community, so for some time we’ve been preparing our own git hosting on Google servers.

We were finishing up just as kernel.org experienced their downtime, so the Gingerbread source is now available on Google’s servers. Accordingly, the git URLs have changed.

Here are the instructions to access the new git servers:

You need to get the latest version of the repo tool:
curl https://dl-ssl.google.com/dl/googlesource/git-repo/repo > ~/bin/repo
You need to initialize a new repository:
repo init -u https://android.googlesource.com/platform/manifest -b android-2.3.7_r1
The full instructions are at http://source.android.com/source/downloading.html

There are a few limitations to be aware of:

Our priority has been getting the main source code mirrors back online, so for the moment gitweb source browsing and Gerrit Code Review are still unavailable.
We are now working on bringing AOSP’s Gerrit Code Review site back up, and hope to be able to say something here soon.
It might be a little while longer before gitweb comes back, unfortunately, since Gerrit Code Review is the next priority.
To reiterate, these servers contain only the ‘gingerbread’ and ‘master’ branches from the old AOSP servers. We plan to release the source for the recently-announced Ice Cream Sandwich soon, once it’s available on devices.
As these new servers are, well, new, there may be hiccups if we encounter unexpected issues. However we’re keeping a close eye on them and will respond to any issues as quickly as possible.

Finally, we’d like to send a huge “thank-you” to the kernel.org community and Oregon State University Open-Source Lab staff. They’ve done an incredible job hosting the AOSP source code mirror and Gerrit Code Review for nearly 3 years. Without them, it’s safe to say that AOSP would not be where we are today.

Thanks, and happy coding!

- Dan

From: https://groups.google.com/forum/#!msg/android-building/IwlEJtE1LsI/WtHcsPkUPMcJ

– EOF –

Two Go Talks: “Lexical Scanning in Go” and “Cuddle: an App Engine Demo”

BianJiang — Sat, 03 Sep 2011 10:55:52 +0800

Rob’s talk, “Lexical Scanning in Go“, discusses the design of a particularly interesting and idiomatic piece of Go code, the lexer component of the new template package.
Lexical Scanning in Go – Rob Pike

The slides are available here. The new template package is available as exp/template in Go release r59. In a future release it will replace the old template package.

Andrew’s talk, “Cuddle: an App Engine Demo“, describes the construction of a simple real-time chat application that uses App Engine’s Datastore, Channel, and Memcache APIs. It also includes a question and answer session that covers Go for App Engine and Go more generally.

Cuddle, A go AppEngine Demo – Andrew Gerrand

The slides are available here. The code is available at the cuddle Google Code project.
From: http://blog.golang.org/2011/09/two-go-talks-lexical-scanning-in-go-and.html

Android 2.3系统彩蛋(Zombie art by Jack Larson)相关代码

BianJiang — Wed, 24 Aug 2011 15:08:57 +0800

Android 2.3系统彩蛋(Zombie art by Jack Larson)相关代码:

在网上看到Android2.3有个“Zombie art by Jack Larson”（Jack Larson 的僵尸艺术）的彩蛋, 没事的时候找了一下相关代码的实现.

packages/apps/Settings/src/com/android/settings/DeviceInfoSettings.java onPreferenceTreeClick
点击Android version相关代码实现:

@Override
public boolean onPreferenceTreeClick(PreferenceScreen preferenceScreen, Preference preference) {
if (preference.getKey().equals("firmware_version")) {
System.arraycopy(mHits, 1, mHits, 0, mHits.length-1);
mHits[mHits.length-1] = SystemClock.uptimeMillis();
if (mHits[0] >= (SystemClock.uptimeMillis()-500)) {
Intent intent = new Intent(Intent.ACTION_MAIN);
intent.setClassName("android",
com.android.internal.app.PlatLogoActivity.class.getName());
try {
startActivity(intent);
} catch (Exception e) {
}
}
}
return super.onPreferenceTreeClick(preferenceScreen, preference);
}

实现代码:

frameworks/base/core/java/com/android/internal/app/PlatLogoActivity.java

public class PlatLogoActivity extends Activity {
Toast mToast;

@Override
protected void onCreate(Bundle savedInstanceState) {
super.onCreate(savedInstanceState);

mToast = Toast.makeText(this, "Zombie art by Jack Larson", Toast.LENGTH_SHORT);

ImageView content = new ImageView(this);
content.setImageResource(com.android.internal.R.drawable.platlogo);
content.setScaleType(ImageView.ScaleType.FIT_CENTER);

setContentView(content);
}

@Override
public boolean dispatchTouchEvent(MotionEvent ev) {
if (ev.getAction() == MotionEvent.ACTION_UP) {
mToast.show();
}
return super.dispatchTouchEvent(ev);
}
}

僵尸图片保存在这里:

frameworks/base/core/res/res/drawable-nodpi/platlogo.jpg

参考: Android 2.3系统隐藏的彩蛋你信不信？