专利详细信息

基于查询接口连接图的深层网页数据源分类管理方法

文献类型：专利

专利类型：发明专利

是否失效：否

是否授权：否

申请号：CN200810024251.8

申请日：20080516

发明人：崔志明赵朋朋方巍

申请人：苏州普达新信息技术有限公司

申请人地址：215021 江苏省苏州市苏州工业园区金鸡湖大道1355号国际科技园二期E101-18

公开日：20110601

公开号：CN101320370B

代理人：陶海锋

代理机构：32103 苏州创元专利商标事务所有限公司

语　　种：中文

摘　　要：本发明公开了一种基于查询接口连接图的深层网页数据源分类管理方法，包括下列步骤：(1)获取深层网页查询接口表单集合；(2)自动抽取步骤(1)获取的查询接口表单的特征值，所述特征值包括表单标签的名称以及属性值；(3)构造表单特征向量；(4)在步骤(3)获得的向量集合中，对每个向量之间通过相似性比较获得关于标签、属性值、标签与属性值组合的关联邻接矩阵；(5)构造查询接口表单集合的连接图，可用关联邻接矩阵表示；(6)利用聚类方法对带权无向图进行聚类；(7)获得深层网页数据源聚类结果。本发明通过有效构造深层网页数据源查询接口连接图，结合图挖掘技术，提高了大规模深层网页数据源自动分类管理的性能。

主权项：1.一种基于查询接口连接图的深层网页数据源分类管理方法，其特征在于，包括下列步骤：(1)获取深层网页查询接口表单集合；(2)自动抽取步骤(1)获取的查询接口表单的特征值，所述特征值包括表单标签的名称以及属性值；(3)构造表单特征向量，包括，将提取的标签的名称和属性值分别构造特征空间LS和VS，对LS和VS中的每个表单形成的特征集合构造一个对应的特征向量，由此获得向量集合；(4)在步骤(3)获得的向量集合中，对每个向量之间通过相似性计算获得关于标签、属性值、标签与属性值组合的查询接口连接图，分别可用LableMatrix、ValueMatrix、LableValueMatrix邻接矩阵来表示，查询接口之间的关联度计算方法为：在基于标签的表单关联度计算中，利用标签的相同特征项的数量进行衡量，并进行标准化， $<math><mrow><msub><mi>Sim</mi><mi>L</mi></msub><mrow><mo>(</mo><msub><mi>F</mi><mn>1</mn></msub><mo>,</mo><msub><mi>F</mi><mn>2</mn></msub><mo>)</mo></mrow><mo>=</mo><mfrac><mi>sw</mi><mi>len</mi></mfrac></mrow></math>$ 其中，sw表示表单F₁和F₂具有相同标签的个数，len表示F₁和F₂中标签特征向量的平均长度，两者相除进行标准化，Sim_L(F₁，F₂)表示基于标签(Label，L)的表单F₁和F₂的关联权值；基于属性值以及标签与属性值组合的表单关联度计算，我们利用其向量之间的相似度函数进行计算， $<math><mrow><msub><mi>Sim</mi><mi>v</mi></msub><mrow><mo>(</mo><msub><mi>F</mi><mn>1</mn></msub><mo>,</mo><msub><mi>F</mi><mn>2</mn></msub><mo>)</mo></mrow><mo>=</mo><mfrac><mrow><munderover><mi>Σ</mi><mrow><mi>k</mi><mo>=</mo><mn>1</mn></mrow><mi>n</mi></munderover><msub><mi>W</mi><mrow><mn>1</mn></p><p class='subject'><strong>关键词：</strong><b class='type_ico_id'></b>查询接口 <b class='type_ico_id'></b>网页数据表单 <b class='type_ico_id'></b>属性值聚类标签特征值 <b class='type_ico_id'></b>向量连接 <b class='type_ico_id'></b>矩阵分类管理方法关联相似性比较表单特征 <b class='type_ico_id'></b>矩阵表示向量集合 <b class='type_ico_id'></b>自动抽取自动分类挖掘管理 </p><p class='class'><strong>IPC专利分类号：</strong>G06F17/30(20060101)</p>
</div>

<div class="article_relate_list">
<div>
<h2 name="ckwx" id="ckwx">
参考文献：</h2>
<div id="listckwx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>
<div>
<h2 name="2jckwx" id="2jckwx">
二级参考文献：</h2>
<div id="list2jckwx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>
<div>
<h2 name="ohwx" id="ohwx">
耦合文献：</h2>
<div id="listohwx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>
<div>
<h2 name="yzwx" id="yzwx">
引证文献：</h2>
<div id="listyzwx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>
<div>
<h2 name="2jyzwx" id="2jyzwx">
二级引证文献：</h2>
<div id="list2jyzwx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>
<div>
<h2 name="tbywx" id="tbywx">
同被引文献：</h2>
<div id="listtbywx">
<p class='submit'>
<img src='/images_new/loading.gif' width='16' height='16' />
正在载入数据...</p>
</div>
</div>

</div>
</div>
<div class="r">

</div>
<div class="clear">
</div>
</div>
</div>
<div class="vlink_layer" style="display: none">
<div class="vlink">
<img src="/template/t1/images/loading2.gif" width="64" height="64">
<span style="font-size:22px;vertical-align:middle;margin-left:20px;">正在为您导引到下载地址...</span>
</div>
<div id="vlink" style="display: none"></div>
</div>

<script type="text/javascript" src="/Template/t5/js/article_relative.min.js"></script>
<script type="text/javascript" src="/js/articlevlink.min.js"></script>

<div class="foot">
<div class="inner">
<p style="text-align: center;">
版权所有©重庆科技学院
<script type="text/javascript">
document.write("2001-" + new Date().getFullYear());
</script>
重庆维普资讯有限公司 <a target="_blank" href="https://beian.miit.gov.cn/#/Integrated/recordQuery">渝B2-20050021-7</a><br />
　<a target="_blank" href="http://www.beian.gov.cn/portal/registerSystemInfo?recordcode=50019002500408"><img style="position:relative; top:5px; margin-right:3px;" src="/images_new/ghs.png" /><span style="color:inherit;">渝公网安备 50019002500408号</span></a>　违法和不良信息举报中心
<p>
</div>
</div>
<a id="backtop" style="display: none" href="javascript:void(0)" title="返回顶部"></a>
<script type="text/javascript">

$(function () {

$('#backtop').hover(function () {
$(this).css({ opacity: 1 });
},
function () {
$(this).css({ opacity: 0.8 });
});

$('#backtop').click(function () {
$('html,body').animate({ scrollTop: 0 }, 100);
});

$(window).scroll(function () {
var scroH = document.documentElement.scrollTop + document.body.scrollTop;
if (scroH > $('.head').height()) {
$('#backtop').show();
} else {
$('#backtop').hide();
}
});
});

/**google代码*/
$(function () {
// (function (i, s, o, g, r, a, m) {
// i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () {
// (i[r].q = i[r].q || []).push(arguments);
// }, i[r].l = 1 * new Date(); a = s.createElement(o),
//m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g;
// m.parentNode.insertBefore(a, m);
// })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
// ga('create', 'UA-2219013-35', 'cqvip.com');
// ga('send', 'pageview');
});

</script>


<script type="text/javascript">
$(function () {
var urlPath = location.href;
var request = g_getUrlParms();

//当检索条件不为空时，为检索框赋值
if (!request.q) {
$("#artcleSearchCondtion").val("");
} else {
var json1 = JSON.parse(request["q"]);
if (!request.invokemethod&&json1.ajaxKeys && urlPath && urlPath.indexOf("articles.aspx")!=-1) {
$("#artcleSearchCondtion").val(decodeURI(json1.ajaxKeys).replace(/\+/g, " "));
$("#dropSearchFieldName").find("option[showField='"+json1.customShowCondition.split('=')[0]+"']").prop("selected","selected");
} else {
$("#artcleSearchCondtion").val("");
}
}

$("#dropSearchFieldName").easySelectBox();

$("#artcleSearchCondtion").keydown(function (event) {
var e = $.event.fix(event);
if (e.keyCode == 13) {
$("#artcleSearchBtn").click();
return false;
}
});

$("#artcleSearchBtn").click(function () {
var fieldValue = $("#artcleSearchCondtion").val();
if (!fieldValue) {
alert("检索内容不能为空！");
} else {
var condition = {};
var fieldName= $("#dropSearchFieldName").val();
var tempField = fieldName.split("@");
var tempFieldName = tempField[0].split("|");

if (tempFieldName[0] == "multiple") //期刊题名或关键词检索条件拼接
{
condition.customRules = "(" + getSearchRules("title_c", fieldValue) + " OR " + getSearchRules("title_e", fieldValue) + " OR " + getSearchRules("keyword_e", fieldValue) + " OR " + getSearchRules("keyword_c", fieldValue) + " OR " + getSearchRules("subject_text", fieldValue) + ")";
}
else {
if (tempFieldName.length == 1) { //当检索规则只含有一个字段
condition.customRules = getSearchRules(tempFieldName, fieldValue);
} else {
var flag = true;
var customStr = "(";
for (var i = 0; i < tempFieldName.length; i++) { //按检索规则字段个数，循环拼接检索条件，此处各字段间为OR关系
if (flag) {
customStr += getSearchRules(tempFieldName[i], fieldValue);
} else {
customStr += " OR " + getSearchRules(tempFieldName[i], fieldValue);
}
flag = false;
}
customStr += ")";
condition.customRules = customStr;
}
}
condition.customShowCondition = tempField[1] + "=" + fieldValue;
condition.ajaxKeys = fieldValue;

location.href = "/3233/articles.aspx?q=" + encodeURIComponent(JSON.stringify(condition));
if (window.event)
window.event.returnValue = false; //ie6fix
}
});
});
/**返回格式化的搜索规则*/
function getSearchRules(fieldName, fieldValue) {
var returnValue = "";
if (fieldName == "worknumber") {
$.ajax({
type: "get",
url: "/ajax/WriterIdByWorkNumber.ashx",
data: { "organid": "" + $('#hidGlobalOrganID').val() + "", "number": "" + fieldValue + "", "_t": new Date },
dataType: 'text',
async: false,
success: function (msg) {
if (!msg) {
msg = "0";
}
returnValue = "({0}:\"{1}\")".format("writerids_s", msg);
}
});
} else {
returnValue = fieldName == "ALL" ? "({0}:\"{1}\")".format(fieldName, fieldValue.toLowerCase()) : "({0}:\"{1}\")".format(fieldName, fieldValue.toLowerCase());
}
return returnValue;
}
</script>

<div class="layer_bg" style="display: none" id="serLayerBg">
</div>
<div class="advance_layer" style="display: none; top: 150px;" id="serAdvanceLayer">
<form>
<div class="advance">
<h6>
<tt class="close" onclick=" g_HideAdvanceSearch(); ">
<img alt="x" src="/Template/t5/images/advance-close.gif"></tt>
</h6>
<div class="cnt" id="cnt1">
<div class="sinput_top">
<div class="sel">
<input type="hidden" id="hfldFieldNameArticles0" name="hfldFieldNameArticles" />
<select name="dropAdvanceSearchFieldName" style="display: none">
</select>
</div>
<div class="input">
<input type="text" name="txtSearchArticles" id="txtSearchArticles0" maxlength="50"/>
</div>
</div>
<div class="sinput">
<div class="s">
<input type="hidden" value=" AND | 与 " name="hfldRelationArticles" id="hfldRelationArticles1" />
<select name="dropAdvanceSearchLogic">
<option value=" AND | 与 ">与</option>
<option value=" OR | 或 ">或</option>
<option value="AND NOT | 非 ">非</option>
</select>
</div>
<div class="sel">
<input type="hidden" id="hfldFieldNameArticles1" name="hfldFieldNameArticles" />
<select name="dropAdvanceSearchFieldName" style="display: none">
</select>
</div>
<div class="input">
<input type="text" name="txtSearchArticles" id="txtSearchArticles1" maxlength="50"/>
</div>
</div>
<div class="sinput" style="display: none">
<div class="s">
<input type="hidden" value=" AND | 与 " name="hfldRelationArticles" id="hfldRelationArticles2" />
<select name="dropAdvanceSearchLogic">
<option value=" AND | 与 ">与</option>
<option value=" OR | 或 ">或</option>
<option value="AND NOT | 非 ">非</option>
</select>
</div>
<div class="sel">
<input type="hidden" id="hfldFieldNameArticles2" name="hfldFieldNameArticles" />
<select name="dropAdvanceSearchFieldName" style="display: none">
</select>
</div>
<div class="input">
<input type="text" name="txtSearchArticles" id="txtSearchArticles2" maxlength="50"/>
</div>
</div>
<div class="sinput" style="display: none">
<div class="s">
<input type="hidden" value=" AND | 与 " name="hfldRelationArticles" id="hfldRelationArticles3" />
<select name="dropAdvanceSearchLogic">
<option value=" AND | 与 ">与</option>
<option value=" OR | 或 ">或</option>
<option value="AND NOT | 非 ">非</option>
</select>
</div>
<div class="sel">
<input type="hidden" id="hfldFieldNameArticles3" name="hfldFieldNameArticles" />
<select name="dropAdvanceSearchFieldName" style="display: none">
</select>
</div>
<div class="input">
<input type="text" name="txtSearchArticles" id="txtSearchArticles3" maxlength="50"/>
</div>
</div>
<div class="sel_op">
<input type="button" class="add" /><input type="button" class="cut" />
</div>
<div class="filter">
<strong>时间：</strong>
<div class="t">
<input type="hidden" value="1989" id="hfldAdvanceStartYear" name="hfldAdvanceStartYear" />
<select name="dropAdvanceSearchYears" id="dropAdvanceSearchStartYears">
</select>
</div>
<span>-</span><div class="t">
<input type="hidden" value="2013" id="hfldAdvanceEndYear" name="hfldAdvanceEndYear" />
<select name="dropAdvanceSearchYears" id="dropAdvanceSearchEndYears">
</select>
</div>
</div>
<div class="filter">
</div>
<div class="submit">
<input type="button" onclick="g_AdvanceSearch(1);" value="确定" class="btn-green">
<input type="button" onclick="g_HideAdvanceSearch();" value="关闭" class="btn-gray">
</div>

</div>
</div>
</form>
</div>
<script type="text/javascript" src="/Template/t5/js/advancesearch.min.js"></script>

<script type="text/javascript">
$(function () {
var encodestr = $("#hifBaseLog").val().trim();
var BaseGch = "";
var BaseArticleId = "";
var BaseClass = "";
var BaseObjectType = 0;
var BaseObjectValue = "";

if (encodestr != "") {
var parames = encodestr.split(';');
BaseGch = parames[0];
BaseArticleId = parames[1];
BaseClass = parames[2];
BaseObjectType = parames[3];
BaseObjectValue = parames[4];
}

var obj = {};
obj.remark = "机构库站点访问记录-重庆科技学院";
obj.user_id = 0;
obj.user_ip_address = "216.73.216.221";
obj.user_group_id = 0;
obj.user_organ_id = 3233;
obj.site_id = 13;
if (BaseGch) {
obj.gch = BaseGch;
}
if (BaseArticleId) {
obj.article_id = BaseArticleId;
}
if (BaseClass) {
obj.full_class_ids = BaseClass;
}
if (BaseObjectType) {
obj.object_id = BaseObjectType;
}
if (BaseObjectValue) {
obj.object_value = BaseObjectValue;
}

loadScript("http://log.cqvip.com/VipCloud/Service/Log/js/analysis.js", function() { vipLog("view", obj,"LIBBEHAVIORANALYSIS"); });
});
</script>
</body>
</html>$

重庆科技学院机构知识库

专利详细信息

基于查询接口连接图的深层网页数据源分类管理方法

我的收藏