没有人要的Sigarra刮削图书馆
feup的Python项目详细描述
没有人要的sigarra scraping库
feupy是一个python库，它为FEUP的信息系统SIGARRA提供接口。sigarra代表sistema de ^{str1}$informa{o para{str1}$gest{o{str1}$agregada dos{str1}$recursos e dos ^{str1}$registos ^{str1}$a{str1}$s{str1}$s{/strong>istemade ^{str1}$a{/str1}$a{/strong>cad{/strong>cad{cad{cad{cad{cad{cad{/（MICOS）（学术注册和聚合资源管理信息系统，给予或接受）。
所有不需要特殊权限的web请求（也就是说，不需要登录就可以查看页面）都存储在一个具有超时的持久缓存中，以便将延迟和对sigarra的请求数量降至最低。所有需要特殊权限（即您需要登录）的web请求都存储在非持久缓存中。
安装
pip install feupy
构建包并上传到pypi
- 将工作目录更改为计算机中此项目的根目录
- 运行这两个命令
python setup.py sdist bdist_wheel python -m twine upload dist/* - 出现提示时输入您的pypi凭据
- 庆祝一下！
生成文档并在本地签出它们
- 确保安装了最新版本的sphinx
- 将工作目录更改为docs/
- 运行此命令
sphinx-build -b html source build - 将工作目录更改为docs/build/
- 运行此命令
python -m http.server 8080 - 在localhost:8080打开Web浏览器
致谢
我要感谢以下人员：
- requests包的维护者
- requests_futures包的维护者
- beautifulsoup4包的维护者
- lxml包的维护者
- Pillow包的维护者
- Miguel Ramalho用于创建sigpy
示例
登录
>>># For a function to be able to access pages where you need to be logged in,>>># you need to pass a Credentials object as an argument to that function.>>>>>># You can tell whether or not a function needs a Credentials object by>>># checking if the function needs a parameter called "credentials">>>>>>fromfeupyimportCredentials>>>>>>credentials=Credentials()Username?:>up201806185Passwordfor201806185?:>>>>credentialsCredentials(201806185)
学生信息
>>>fromfeupyimportStudent>>>frompprintimportpprint>>>>>>daniel=Student(201806185)# That's me!>>>print(f"Hello, {daniel.name}!")Hello,DanielFilipeAmaroMonteiro!>>>pprint(daniel.courses)({'course':Course(742,2019),# MIEIC'first academic year':2018,# (2018/2019)'institution':'Faculty of Engineering'},)# Best faculty
教师信息
>>>fromfeupyimportTeacher>>>>>>jlopes=Teacher(230756)>>>>>>print(f"Thanks for teaching us Python, {jlopes.name}!")ThanksforteachingusPython,JoãoAntónioCorreiaLopes!>>>>>>print(jlopes.presentation)PersonalPresentationJoãoCorreiaLopesisanAssistantProfessorinInformaticsEngineeringattheUniversidadedoPortoandaseniorresearcheratINESCTEC.HehasgraduatedinElectricalEngineeringintheUniversityofPortoin1984andholdsaPhDinComputingSciencebyGlasgowUniversityin1997.Histeachingincludesundergraduateandgraduatecoursesindatabasesandwebapplications,softwareengineeringandprogramming,markuplanguagesandsemanticweb.Hehasbeeninvolvedinresearchprojectsintheareaofdatamanagement,service-orientedarchitecturesande-Science.Currentlyhismainresearchinterestsaree-Scienceandresearchdatamanagement.ResearcherIDORCIDGoogleScholarCitationsDBLPAuthorScopusAuthor>>>>>>pprint(vars(jlopes)){'acronym':'JCL','career':'Pessoal Docente de Universidades','category':'Professor Auxiliar','department':'Department of Informatics Engineering','email':None,'links':('http://www.fe.up.pt/~jlopes/','https://www.authenticus.pt/R-000-6RX','http://orcid.org/0000-0002-9040-0889'),'name':'João António Correia Lopes','p_codigo':230756,'personal_webpage':'http://www.fe.up.pt/~jlopes/','presentation':'Personal Presentation\n''João Correia Lopes is an Assistant Professor in Informatics ''Engineering at the Universidade do Porto and...',#etc'profession':'Docente','rooms':'I129','status':'Active','url':'https://sigarra.up.pt/feup/en/func_geral.formview?p_codigo=230756','voip':3375}
课程单元信息
>>>fromfeupyimportCurricularUnit>>>>>>fpro=CurricularUnit(419983)>>>>>>fpro.name'Programming Fundamentals'>>>fpro.acronym'FPRO'>>>>>>pprint(vars(fpro)){'ECTS_credits':6.0,'academic_year':2018,'acronym':'FPRO','code':'EIC0005','curricular_year':1,'has_moodle':True,'is_active':True,'name':'Programming Fundamentals','number_of_students':182,'pv_ocorrencia_id':419983,'regents':(Teacher(230756),),'semester':1,'teachers':(Teacher(230756),Teacher(230756),Teacher(520205),Teacher(552793),Teacher(209847)),'text':'Teaching language\n''Portuguese\n''Objectives\n''1 - BACKGROUND\n''Fluency in the process of software development is a basic ''prerequisite to the work of Informatics Engineers. In order to use ''computers to solve problems effectively, students must be competent ''at reading and writing programs using higher-order programming ''languages.\n''2 - SPECIFIC AIMS...',# etc'url':'https://sigarra.up.pt/feup/en/ucurr_geral.ficha_uc_view?pv_ocorrencia_id=419983','webpage_url':'https://web.fe.up.pt/~jlopes/doku.php/teach/fpro/index'}>>>>>>pprint(fpro.other_occurrences())(CurricularUnit(436425),CurricularUnit(419983),CurricularUnit(399878),CurricularUnit(384923),CurricularUnit(368689),CurricularUnit(350482),CurricularUnit(332985),CurricularUnit(272575),CurricularUnit(272574),CurricularUnit(272573),CurricularUnit(272572),CurricularUnit(272571),CurricularUnit(272570),CurricularUnit(272569))>>>[uc.academic_yearforucinfpro.other_occurrences()][2019,2018,2017,2016,2015,2014,2013,2012,2011,2010,2009,2008,2007,2006]>>>>>>pprint(fpro.classes(credentials))# Remember the Credentials object we created earlier?{'1MIEIC01':[Student(201800000),Student(201800001),Student(201800002),Student(201800003)],'1MIEIC02':[Student(201800004),Student(201800005),Student(201800006),Student(201800007),Student(201800008),Student(201800009),Student(201800010),Student(201800011),Student(201800012)],'...':[...]# etc}>>>>>>pprint(fpro.students(credentials))# (student, status, number of registrations, student type)[(Student(201800001),'Ordinário',1,'Normal'),(Student(201800002),'Ordinário',1,'Normal'),(Student(201800003),'Ordinário',1,'Normal'),(Student(201800004),'Estudante internacional',1,'Normal'),(Student(201800005),'Estudante internacional',1,'Normal'),(Student(201800006),'Ordinário',1,'Normal'),(Student(201800007),'Ordinário',1,'Normal'),(Student(201800008),'Ordinário',2,'Normal'),(Student(201800009),'Ordinário',2,'Normal'),(Student(201800010),'Ordinário',1,'Normal'),(Student(201800011),'Estudante internacional',1,'Normal'),(Student(201800012),'Trabalhador-Estudante',1,'Normal'),...# etc]>>>>>>pprint(fpro.results(credentials))# Get the results from the exams{'Época Normal (1ºS)':[(Student(201800001),10),(Student(201800002),13),(Student(201800003),10),(Student(201800004),'RFE'),(Student(201800005),'RFF'),(Student(201800006),'RFF'),...],# etc'Época Recurso (1ºS)':[(Student(201800008),11),(Student(201800009),7),(Student(201800010),8),(Student(201800011),8),(Student(201800012),'RFE'),(Student(201800013),13),(Student(201800014),5),(Student(201800019),'RFC'),...]}# etc>>>>>>pprint(fpro.timetable(credentials))# Returns the classes from the timetable as dicts[{'class type':'TP','classes':('1MIEIC04',),'curricular unit':CurricularUnit(419983),'finish':datetime.time(10,0),'room':('B307',),'start':datetime.time(8,0),'teachers':(Teacher(209847),Teacher(520205)),'weekday':'Monday'},{'class type':'TP','classes':('1MIEIC01',),'curricular unit':CurricularUnit(419983),'finish':datetime.time(10,30),'room':('B302',),'start':datetime.time(8,30),'teachers':(Teacher(230756),),'weekday':'Tuesday'},{'class type':'T','classes':('1MIEIC01','1MIEIC02','1MIEIC03','1MIEIC04','1MIEIC05','1MIEIC06','1MIEIC07','1MIEIC08'),'curricular unit':CurricularUnit(419983),'finish':datetime.time(13,30),'room':('B002',),'start':datetime.time(12,0),'teachers':(Teacher(230756),),'weekday':'Tuesday'},{'class type':'TP','classes':('1MIEIC06',),'curricular unit':CurricularUnit(419983),'finish':datetime.time(13,30),'room':('B310',),'start':datetime.time(11,30),'teachers':(Teacher(209847),Teacher(552793)),'weekday':'Wednesday'},...]# etc
课程信息
>>>fromfeupyimportCourse>>>>>>mieic=Course(742)>>>>>>mieic.name'Master in Informatics and Computing Engineering'>>>mieic.acronym'MIEIC'>>>[director.namefordirectorinmieic.directors]# Let's see the names of the directors['João Carlos Pascoal Faria','Maria Cristina de Carvalho Alves Ribeiro']>>>>>>pprint(vars(mieic)){'acronym':'MIEIC','directors':(Teacher(210006),Teacher(209566)),'name':'Master in Informatics and Computing Engineering','official_code':9459,'pv_ano_lectivo':2019,'pv_curso_id':742,'text':'The Integrated Master in Informatics and Computing Engineering has ''been awarded the international EUR-ACE quality label. This certifies ''MIEIC as a high-quality programme which meets the international ''standards for professional engineering education at the masters ''level. [+ info]\n''\n''Accreditation by A3ES\r\n''The Agency for Assessment and Accreditation of Higher Education ''(A3ES), at 20th of June, 2014, and in accordance with the ''recomendation and fundamentation produced by the respective External '...,# etc'url':'https://sigarra.up.pt/feup/en/cur_geral.cur_view?pv_curso_id=742&pv_ano_lectivo=2019'}>>>>>>pprint(mieic.exams())# Let's see this courses's currently scheduled exams[{'curricular unit':CurricularUnit(420037),'finish':datetime.datetime(2019,9,6,20,0),'observations':'Tenho um exame de outra disciplina marcado para esse ''horário e assim juntava os dois.\r\n''José LuÃs Moura Borges\r\n','rooms':('B222',),'season':'Especial de Conclusão - SET-E-ESPECIAL','start':datetime.datetime(2019,9,6,17,0)},...,# etc{'curricular unit':CurricularUnit(438941),'finish':datetime.datetime(2019,9,26,13,0),'observations':None,'rooms':('B104','B208','B213'),'season':'Exames ao abrigo de estatutos especiais - Mini-testes (1ºS)','start':datetime.datetime(2019,9,26,9,0)},{'curricular unit':CurricularUnit(438941),'finish':datetime.datetime(2019,9,26,17,30),'observations':None,'rooms':('B104','B213','B208','B207'),'season':'Exames ao abrigo de estatutos especiais - Mini-testes (1ºS)','start':datetime.datetime(2019,9,26,13,30)}]>>>>>>mieic.curricular_units()# All the curricular units (with a link) from that course[CurricularUnit(446081),CurricularUnit(437142),CurricularUnit(438941),CurricularUnit(436401),CurricularUnit(436402),CurricularUnit(436403),CurricularUnit(436404),CurricularUnit(436405),CurricularUnit(436406),CurricularUnit(436407),CurricularUnit(436408),CurricularUnit(436409),CurricularUnit(436410),CurricularUnit(436411),CurricularUnit(436412),CurricularUnit(436413),CurricularUnit(436414),CurricularUnit(436415),CurricularUnit(436416),CurricularUnit(436417),CurricularUnit(436418),CurricularUnit(436419),CurricularUnit(436420),CurricularUnit(436421),CurricularUnit(436422),CurricularUnit(436423),CurricularUnit(436424),CurricularUnit(436425),CurricularUnit(436426),CurricularUnit(436427),CurricularUnit(436428),CurricularUnit(436429),CurricularUnit(436430),CurricularUnit(436431),CurricularUnit(436432),CurricularUnit(436433),CurricularUnit(436434),CurricularUnit(436435),CurricularUnit(436436),CurricularUnit(436437),CurricularUnit(436438),CurricularUnit(436439),CurricularUnit(436440),CurricularUnit(436441),CurricularUnit(436442),CurricularUnit(436443),CurricularUnit(436444),CurricularUnit(436445),CurricularUnit(436446),CurricularUnit(436447),CurricularUnit(436448),CurricularUnit(436449),CurricularUnit(436450),CurricularUnit(436451),CurricularUnit(436452),CurricularUnit(436453),CurricularUnit(436454),CurricularUnit(436455),CurricularUnit(436456),CurricularUnit(436457),CurricularUnit(436458),CurricularUnit(436459),CurricularUnit(436460),CurricularUnit(436461),CurricularUnit(436462),CurricularUnit(436463),CurricularUnit(436464),CurricularUnit(436465),CurricularUnit(436466),CurricularUnit(436467),CurricularUnit(436468),CurricularUnit(436469),CurricularUnit(436470),CurricularUnit(436471)]>>>len(mieic.curricular_units())# Just out of curiosity74>>>[ucforucinmieic.curricular_units()ifuc.curricular_year==2anduc.semester==1]# The uc's I will have this semester[CurricularUnit(436433),CurricularUnit(436434),CurricularUnit(436435),CurricularUnit(436436),CurricularUnit(436437)]
个人信息
>>>fromfeupyimportUser>>>>>>me=User.from_credentials(credentials)>>>me.course.acronym'MIEIC'>>>>>>pprint(me.courses_units())# Curricular unit , grade[(CurricularUnit(436433),None),(CurricularUnit(436434),None),(CurricularUnit(436435),None),(CurricularUnit(436436),None),(CurricularUnit(436437),None),(CurricularUnit(436439),None),(CurricularUnit(436438),None),(CurricularUnit(436441),None),(CurricularUnit(436442),None),(CurricularUnit(436440),None),(CurricularUnit(419981),10),(CurricularUnit(419982),11),(CurricularUnit(419985),12),(CurricularUnit(419983),13),(CurricularUnit(419984),14),(CurricularUnit(420521),15),(CurricularUnit(419986),16),(CurricularUnit(419987),17),(CurricularUnit(419990),18),(CurricularUnit(419989),19),(CurricularUnit(419988),20)]
欢迎加入QQ群-->： 979659372
